EvSys

constants

Central constants for the evsys_sdk SDK.

Single source of truth for env-var names, defaults, HTTP endpoint paths, status strings, and logging config. Change endpoints / defaults here - not scattered across the codebase.

Distinct from config.py, which holds the user-facing Pydantic experiment config models (ExperimentConfig, RunConfig, ...). This module is SDK app-level plumbing.

attributeEVSYS_API_URL_ENV
= 'EVSYS_API_URL'
attributeEVSYS_API_KEY_ENV
= 'EVSYS_API_KEY'
attributeEVSYS_PROJECT_ID_ENV
= 'EVSYS_PROJECT_ID'
attributeEVSYS_LOG_DIR_ENV
= 'EVSYS_LOG_DIR'
attributeEVSYS_OFFLINE_ENV
= 'EVSYS_OFFLINE'
attributeEVSYS_LOGGING_LEVEL_ENV
= 'EVSYS_LOGGING_LEVEL'
attributeDEFAULT_API_URL
= 'http://localhost:8000'
attributeDEFAULT_LOG_DIR
= './evsys_sdk'
attributeDEFAULT_TIMEOUT_S
= 30.0
attributeAPI_PREFIX
= '/api/dashboard/api'
attributeEP_CREATE_EXPERIMENT
= '/sdk/experiments/'
attributeEP_UPDATE_EXPERIMENT
= '/sdk/experiments/{experiment_id}/'
attributeEP_CREATE_RUN
= '/sdk/runs/'
attributeEP_UPDATE_RUN
= '/sdk/runs/{run_id}/'
attributeEP_LOG_METRICS
= '/sdk/runs/{run_id}/metrics/'
attributeEP_LOG_EVAL
= '/sdk/runs/{run_id}/evals/'
attributeEP_ADD_CHECKPOINT
= '/sdk/runs/{run_id}/checkpoints/'
attributeEP_LOG_PREDICTIONS
= '/sdk/runs/{run_id}/predictions/'
attributeKEY_EXPERIMENT
= 'experiment'
attributeKEY_RUN
= 'run'
attributeKEY_RAW
= '_raw'
attributeFIELD_PROJECT_ID
= 'project_id'
attributeFIELD_BEST_SCORE
= 'best_score'
attributeFIELD_ERROR_MESSAGE
= 'error_message'
attributeFIELD_CONCLUSION
= 'conclusion'
attributeSTATUS_PENDING
= 'pending'
attributeSTATUS_RUNNING
= 'running'
attributeSTATUS_COMPLETED
= 'completed'
attributeSTATUS_FAILED
= 'failed'
attributeSTATUS_CANCELLED
= 'cancelled'
attributeHEADER_AUTHORIZATION
= 'Authorization'
attributeHEADER_CONTENT_TYPE
= 'Content-Type'
attributeCONTENT_TYPE_JSON
= 'application/json'
attributeDEFAULT_LOGGING_LEVEL
= 'INFO'
attributeSUPPORTED_LOGGING_LEVELS
= ['DEBUG', 'INFO', 'WARNING', 'ERROR', 'CRITICAL']
attributeDEFAULT_LOG_FORMAT
= '%(asctime)s - %(name)s - %(levelname)s - %(filename)s:%(lineno)d - %(message)s'
attributeDEFAULT_LOG_DATE_FORMAT
= '%Y-%m-%d %H:%M:%S'
attributeLOGGER_NAME
= 'evsys_sdk'
attributeLOCAL_EXPERIMENT_FILE
= 'experiment.json'
attributeLOCAL_GENERATION_FILE
= 'generation.json'
attributeLOCAL_METRICS_FILE
= 'metrics.jsonl'
attributeLOCAL_EVALS_FILE
= 'evals.jsonl'
attributeLOCAL_PREDICTIONS_FILE
= 'predictions.jsonl'
funcbearer(api_key) -> str
paramapi_keystr

Returns

str
functruthy_env(value) -> bool

Interpret an env var string as a boolean.

paramvaluestr | None

Returns

bool