janus.llm.models_info#

Classes#

`JanusModelProtocol`	Base class for protocol classes.
`JanusModel`	Base class for protocol classes.

Functions#

`get_available_model_names`()
`load_model`(model_id)

Module Contents#

janus.llm.models_info.log#

janus.llm.models_info.ModelType#

class janus.llm.models_info.JanusModelProtocol#

Bases: Protocol

Base class for protocol classes.

Protocol classes are defined as:

class Proto(Protocol):
    def meth(self) -> int:
        ...

Such classes are primarily used with static type checkers that recognize structural subtyping (static duck-typing).

For example:

class C:
    def meth(self) -> int:
        return 0

def func(x: Proto) -> int:
    return x.meth()

func(C())  # Passes static type check

See PEP 544 for details. Protocol classes decorated with @typing.runtime_checkable act as simple-minded runtime protocols that check only the presence of given attributes, ignoring their type signatures. Protocol classes can be generic, they are defined as:

class GenProto(Protocol[T]):
    def meth(self) -> T:
        ...

model_id: str#

model_type_name: str#

token_limit: int#

input_token_cost: float#

output_token_cost: float#

prompt_engine: type[janus.prompts.prompt.PromptEngine]#

get_num_tokens(text)#

Parameters:: text (str) –
Return type:: int

class janus.llm.models_info.JanusModel#

Bases: langchain_core.runnables.Runnable, JanusModelProtocol

Base class for protocol classes.

Protocol classes are defined as:

class Proto(Protocol):
    def meth(self) -> int:
        ...

Such classes are primarily used with static type checkers that recognize structural subtyping (static duck-typing).

For example:

class C:
    def meth(self) -> int:
        return 0

def func(x: Proto) -> int:
    return x.meth()

func(C())  # Passes static type check

See PEP 544 for details. Protocol classes decorated with @typing.runtime_checkable act as simple-minded runtime protocols that check only the presence of given attributes, ignoring their type signatures. Protocol classes can be generic, they are defined as:

class GenProto(Protocol[T]):
    def meth(self) -> T:
        ...

janus.llm.models_info.openai_models = ['gpt-4o', 'gpt-4o-mini', 'gpt-4', 'gpt-4-turbo', 'gpt-4-turbo-preview', 'gpt-3.5-turbo',...#

janus.llm.models_info.azure_models = ['gpt-4o', 'gpt-4o-mini', 'gpt-3.5-turbo-16k']#

janus.llm.models_info.claude_models = ['bedrock-claude-v2', 'bedrock-claude-instant-v1', 'bedrock-claude-haiku',...#

janus.llm.models_info.llama2_models = ['bedrock-llama2-70b', 'bedrock-llama2-70b-chat', 'bedrock-llama2-13b', 'bedrock-llama2-13b-chat']#

janus.llm.models_info.llama3_models = ['bedrock-llama3-8b-instruct', 'bedrock-llama3-70b-instruct']#

janus.llm.models_info.titan_models = ['bedrock-titan-text-lite', 'bedrock-titan-text-express', 'bedrock-jurassic-2-mid',...#

janus.llm.models_info.cohere_models = ['bedrock-command-r-plus']#

janus.llm.models_info.mistral_models = ['bedrock-mistral-7b-instruct', 'bedrock-mistral-large', 'bedrock-mixtral']#

janus.llm.models_info.bedrock_models#

janus.llm.models_info.all_models#

janus.llm.models_info.MODEL_TYPE_CONSTRUCTORS: dict[str, ModelType]#

janus.llm.models_info.MODEL_PROMPT_ENGINES: dict[str, Callable[Ellipsis, janus.prompts.prompt.PromptEngine]]#

janus.llm.models_info.MODEL_ID_TO_LONG_ID#

janus.llm.models_info.MODEL_DEFAULT_ARGUMENTS: dict[str, dict[str, str]]#

janus.llm.models_info.DEFAULT_MODELS#

janus.llm.models_info.MODEL_CONFIG_DIR#

janus.llm.models_info.MODEL_TYPES: dict[str, janus.prompts.prompt.PromptEngine]#

janus.llm.models_info.TOKEN_LIMITS: dict[str, int]#

janus.llm.models_info.get_available_model_names()#

Return type:: list[str]

janus.llm.models_info.load_model(model_id)#

Return type:: load_model.JanusModel