Maximizing Quota Usage: A Guide to Requesting More Quotas

Requesting Quota's for online_prediction_requests_... - Google ...

Share this topicLinkedInTwitterCopy URL

Introduction

Howdy y'all  🤠

I am interested in trying out the sec-palm@001  model to evaluate its usefulness in cybersecurity applications. I can see it in the Vertex AI Studio under the freeform/experimental models, but I get the dreaded 429 everyone is coming to know and love. Does <PII removed by staff> use dynamic quota's? What would be the process of requesting quota's for it, and in the event I do get the quota raised, should I expect it to be something in the 5-10 RPM ballpark? Because that may render it virtually unusable for testing, so I may just give it up before its began on this one. 

Exploring Options

Also, there is no mention of that model in the release notes or documentation, just stuff from RSA23 and the Cloud Sec podcast talk about sec-palm vs SecLM, which I am not holding my breath on being GA for a bit, so I was hoping to tinker with <PII removed by staff>  in the meantime.

Any help would be appreciated, a link to any kind of documentation on sec-palm@001, official or otherwise, would be even more appreciated

Error Report

Here is my 429 error:

Thanks! never-displayed