Task
Image Text To Text
F
adept/fuyu-8b
Image Text To Text·adept· 132.4K· 1.0K
We’re releasing Fuyu-8B, a small version of the multimodal model that powers our product. The model is available on HuggingFace. We think Fuyu-8B is exciting because: 1. It has a much simpler architecture and training procedure than other multi-modal models, which makes it easier to understand, scale, and deploy. 2. It’s designed from the ground up for digital agents, so it can support arbitrary i
# pull & run locally
pip install mlforge-sdk && mlforge pull adept/fuyu-8b
pip install mlforge-sdk && mlforge pull adept/fuyu-8b
Model details
Provider
adept
Framework
transformers
Parameters
9.4B
Size
35 GB
License
cc-by-nc-4.0
Downloads
132.4K
Likes
1.0K
Updated
2023-11-04
About adept/fuyu-8b
We’re releasing Fuyu-8B, a small version of the multimodal model that powers our product. The model is available on HuggingFace. We think Fuyu-8B is exciting because: 1. It has a much simpler architecture and training procedure than other multi-modal models, which makes it easier to understand, scale, and deploy. 2. It’s designed from the ground up for digital agents, so it can support arbitrary image resolutions, answer questions about graphs and diagrams, answer UI-based questions, and do fine-grained localization on screen images. 3. It’s fast - we can get responses for large images in less than 100 milliseconds. 4. Despite being optimized for our use-case, it performs well at standard image understanding benchmarks such as visual question-answering and natural-image-captioning.