|
|
--- |
|
|
license: mit |
|
|
datasets: |
|
|
- teapotai/synthqa |
|
|
language: |
|
|
- en |
|
|
- fr |
|
|
- ro |
|
|
- de |
|
|
- multilingual |
|
|
library_name: transformers.js |
|
|
tags: |
|
|
- text2text-generation |
|
|
- 783M |
|
|
base_model: |
|
|
- teapotai/teapotllm |
|
|
pipeline_tag: text2text-generation |
|
|
--- |
|
|
|
|
|
# TeapotAI TeapotLLM ONNX |
|
|
|
|
|
ONNX version of [teapotai/teapotllm](https://huggingface.co/teapotai/teapotllm) to use with [Transformers.js](https://github.com/huggingface/transformers.js). |
|
|
|
|
|
Also includes a JavaScript version of the teapotai python package for interacting with the model using the Transformers.js library. |
|
|
|
|
|
View the example script [index.js](https://huggingface.co/tomasmcm/teapotai-teapotllm-onnx/blob/main/index.js). |
|
|
|
|
|
**Check the [WebGPU ONNX Playground](https://huggingface.co/spaces/tomasmcm/teapotai-teapotllm-onnx).** |
|
|
|
|
|
## Installation |
|
|
|
|
|
```bash |
|
|
yarn install |
|
|
``` |
|
|
|
|
|
## Usage |
|
|
|
|
|
This library provides a `TeapotAI` class that helps you interact with language models. Here's a basic example: |
|
|
|
|
|
```javascript |
|
|
import TeapotAI from './TeapotAI.js'; |
|
|
|
|
|
const ai = new TeapotAI({ |
|
|
pipelineOptions: { |
|
|
dtype: 'q4' |
|
|
} |
|
|
}); |
|
|
|
|
|
// Query with context |
|
|
const response = await ai.query( |
|
|
"What is the capital?", |
|
|
"France is a country in Western Europe." |
|
|
); |
|
|
``` |
|
|
|
