Depending on your use case, batching may help . If you are sending multiple requests to the same endpoint, you can
batch the prompts to be sent in the same request. This will reduce the number of requests you need to make. The prompt parameter can hold up to 20 unique prompts. We advise you to test out this method and see if it helps. In some...
See more