Skip to main contentPublish prompt
- A new method has been added to the SDK
basalt.prompt.publish. This method allow users to programmatically publish a prompt.
Traces & logs
- Accept arrays as
input, output and ideal_output
- Better support of
input_tokens, output_tokens and cost
Python version
- Minimal python version is now 3.10
Development experience improvement
- Modification of the typings and documentation for a better developer experience when using the Python SDK
- Review methods to better support of async and add
sync methods.
Experiments
- Added
idealOutput params to traces and logs for ground truth evaluation in experiments
Datasets
- Support of dataset methods
- Caching of datasets
Add methods
- Added
setEvaluatorConfig to traces
- Added
setExperiment to traces
Evaluations
- Added evaluations at the trace and log level.
Latency & Costs
- Added support for latency and costs through the monitoring system.
Patch for Basic Monitoring
- Patch the
generation.end() that were not well flushed in certain cases.
Basic Monitoring
- Implemented basic monitoring after getting a prompt.
Patch for trace.end()
- Patch for
trace.end() to allow for more flexible trace ending.
Monitoring
- Added support for monitoring.
- Added support for tracing.
List and Describe prompts
- Added support for listing and describing prompts.
First release of the SDK 🎉
- Added support for getting prompts.
