Low volume = High latency | C2C Community
Solved

Low volume = High latency

  • 25 February 2023
  • 4 replies
  • 51 views
A

As a startup with a small number of users, one of our struggles with GCP has been latency. Cloud functions, gateways, and even pubsub are taking > 5 seconds. This is causing poor user experience, and timeouts from third party webhooks, etc.

We are finding ourselves needing to set min instance counts on functions, and run heartbeats on api gateways to keep them warm. (We haven’t yet solved the slowness with pubsub).

Is this par for the course? What have others experienced?

icon

Best answer by seijimanoan 25 February 2023, 17:16

View original

4 replies

Vick
Rank
Userlevel 7
Badge +12

I think it has to do with your configurations 

seijimanoan
Rank
Userlevel 6
Badge +11

Hey there!

I understand the serverless workload can have cold start. And it may have other issues like application boot time with dependencies etc. Look at instance concurrency.

The PubSub have some strategies: pull and push. It can push over HTTPS, or you can pull those messages in a worker. Or are you using any other trigger?

 

Ah! I found something interesting https://cloud.google.com/api-gateway/docs/gateway-serverless-neg

Dimitris Petrakis
Rank
Userlevel 7
Badge +28

Hello @andave. Was @seijimanoan’s answer perhaps helpful to your question? 😎 

seijimanoan
Rank
Userlevel 6
Badge +11

Hey! Plus, it has been new content with many tips from Google Cloud Tech like these

 

And many others. I hope any of them can be helpful or brings more insights. Please, also look over there.

Reply


Recently Awarded Badges

Show all badges
Terms & Conditions