Gemini API: Increased File Size Limits & Expanded Input Support
- Google Cloud has announced updates to its files API, focusing on improved data ingestion methods, including direct registration of Google Cloud Storage (GCS) files and increased inline file...
- The Files API now allows direct registration of files stored in Google Cloud Storage, eliminating the need to transfer data for use with the API.
- This feature streamlines workflows for developers already utilizing GCS, reducing latency and storage costs associated with data movement.Previously, users needed to upload files directly to the API; now,...
Google Cloud has announced updates to its files API, focusing on improved data ingestion methods, including direct registration of Google Cloud Storage (GCS) files and increased inline file limits. These changes aim to provide developers with a more flexible and efficient toolkit for managing data.
Google cloud Storage (GCS) File Registration
The Files API now allows direct registration of files stored in Google Cloud Storage, eliminating the need to transfer data for use with the API.
This feature streamlines workflows for developers already utilizing GCS, reducing latency and storage costs associated with data movement.Previously, users needed to upload files directly to the API; now, the API can access and utilize files already residing in GCS buckets.
For example, a developer working with image processing could directly register images stored in a GCS bucket with the Files API, avoiding the step of downloading and re-uploading the images.
Increased Inline File Limits
The maximum payload size for inline data submitted to the Files API has been increased from 20MB to 100MB (base64 encoded), with limits varying based on data type.
This enhancement caters to developers who prefer the simplicity of inline file handling for prototyping, real-time applications, and smaller data sets.The increased limit supports larger images and audio clips without requiring intermediate storage solutions. The encoding method (base64) impacts the actual file size limit due to its inherent overhead.
as of December 6, 2023, Google announced this increase, stating it is indeed “ideal for prototyping, real-time applications, and handling larger images or short audio clips without needing any intermediate storage.”
Files API Documentation
The official Files API documentation provides detailed facts on usage,limitations,and best practices for both GCS file registration and inline file handling.
The documentation includes code samples in various programming languages and outlines the specific data type limitations for inline files. It also details the authentication and authorization requirements for accessing GCS buckets.
