Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
WolfInk
/
ConexusLite
like
1
Running
App
Files
Files
Community
ca3dea7
ConexusLite
/
tokenizer_config (1).json
WolfInk
Upload 9 files
89edd6c
verified
6 months ago
raw
Copy download link
history
blame
Safe
137 Bytes
{
"clean_up_tokenization_spaces"
:
true
,
"model_max_length"
:
512
,
"tokenizer_class"
:
"OpenAIGPTTokenizer"
,
"unk_token"
:
"<unk>"
}