Text Generation
LiteRT-LM

Use this model not working with Google Colab

#3
by Nirav-Madhani - opened

Using this model button showing Colab option but that now working.

Url key_Function

integration status unknown.

Please clone model and use locally.

Also feel free to open a Pull request

for integration of the huggingface model hub

into the corresponding library =)

How to use it?

Google org

Hi ,

Its looks like the Colab button integration is currently broken or not functional for this model. The "colab" option might be visible, This may due to a missing Colab Notebook or an outdated integration.

Please clone the model repository and run it locally using this below steps :

git clone https : //huggingface.co/your-model-path

And install required dependencies , Load and run the model locally with Hugging Face Transformers or your framework.

Kindly try and let us know if you have any concerns will assist you.

Thank you.

Thanks. After going in depth through documentation, I believe, this is not suppose to run with HF the way we run models using pipelines and use https://github.com/google-ai-edge/LiteRT-LM built on top of https://github.com/google-ai-edge/LiteRT. Only LiteRT-LM is supposed to work and therefore other buttons must be hidden or a hacky notebook is needed to install framework and run.

Nirav-Madhani changed discussion status to closed

Sign up or log in to comment