Low volume = High latency | C2C Community
Solved

Low volume = High latency

  • 25 February 2023
  • 4 replies
  • 68 views

As a startup with a small number of users, one of our struggles with GCP has been latency. Cloud functions, gateways, and even pubsub are taking > 5 seconds. This is causing poor user experience, and timeouts from third party webhooks, etc.

We are finding ourselves needing to set min instance counts on functions, and run heartbeats on api gateways to keep them warm. (We haven’t yet solved the slowness with pubsub).

Is this par for the course? What have others experienced?

icon

Best answer by seijimanoan 25 February 2023, 17:16

View original

4 replies

Userlevel 7
Badge +12

I think it has to do with your configurations 

Userlevel 6
Badge +11

Hey there!

I understand the serverless workload can have cold start. And it may have other issues like application boot time with dependencies etc. Look at instance concurrency.

The PubSub have some strategies: pull and push. It can push over HTTPS, or you can pull those messages in a worker. Or are you using any other trigger?

 

Ah! I found something interesting https://cloud.google.com/api-gateway/docs/gateway-serverless-neg

Userlevel 7
Badge +29

Hello @andave. Was @seijimanoan’s answer perhaps helpful to your question? 😎 

Userlevel 6
Badge +11

Hey! Plus, it has been new content with many tips from Google Cloud Tech like these

 

And many others. I hope any of them can be helpful or brings more insights. Please, also look over there.

Reply