Parse Server periodically is getting slow

[Samigos]

• parse-server version 2.7.4 (Azure on a Standard_B4ms)
• mongoDB-server version 3.4.14 (Azure on a separate Standard_B4ms)

I have an iOS & Android app, with LiveQuery (set on the parse-server's VM) that's being used a lot for chatting, where usually there are ± 50 simultaneous users. The thing is, after a few hours of continuous usage, the server's cloud code responses are getting REALLY slow! Not just from a specific one... all cloud functions!

I'm using screen to run the parse server. So I found that if I restart the parse server (not the vm), the app is getting back to normal.

I also have logs enabled at all times. (just mentioning it in case it could be the issue)

I can't understand why this is happening!
Any ideas?

[georgesjamous]

I also have logs enabled at all times. (just mentioning it in case it could be the issue)

Depending on the log level set, it could cause problems.
Do you mean verbose is always on ?

[Samigos]

@georgesjamous I have it on default... It shows every cloud call's params and response!
I haven't added the verbose option at all...

[georgesjamous]

Alright, forget logging for a second. How about the cache. Are you using Redis ? or the default memory cache?

[georgesjamous]

Just trying to narrow down the problem for my self and other people who stumble upon this issue.
It doesn't necessarily have to be a Live Query problem, but it could.

[Samigos]

I'm not using any caching mechanism!

I'm thinking that LiveQuery may be the issue, because in the Parse's docs they propose to set the LiveQuery server on a different machine and I haven't! Although, 50 users chatting at the same time shouldn't cause this problem! I don't think they're that many!

[flovilmart]

You should probably run a profiler attached to your process or an APM that will help you quantify how slow.

[georgesjamous]

@Samigos i think you should try what flovilmart suggested.

Some additional notes:
There are lots of stuff that should be taken into consideration before you considering this as an issue.

First off, Yes, it's far better to have LiveQuery on a separate server, try that.
Also, I am not sure how much RAM or CPUs your Azure instance has, but if you are running everything (custom cloud logic + live query + accessing the via SDKs) on a single NodeJs instance, then I am sure the problem lies there. Since most of these operations will be queued-up/throttled in node.
Secondly, the amount of Data in/out of your instance need to be considered also, for example, what does your custom cloud code logic do ? how many calls ps is each user doing additionally to LiveQ? How many objects are you returning in a single query ? (Tip: keep it low, cache on user devices)
In other words, if you are doing a bunch of additional requests concurrently with LiveQ all running on the same instance then yes, your problem is to be expected :)

Look how I think your debugging should go,
1- Split LiveQ from your main server
(test if this speeds things up a bit)
2- Run Parse clustered. To the N-1. N is the number of cores your CPU has. (< 2 cores one instance, like you are doing now. 3 cores run 2, and so on)
(test if this speeds things up a bit)
3- Start using Redis Cache, this will free up some memory if you have lots of Roles or 5+ levels deep)
(test if this speeds things up a bit)
4- debug your code, how many request are you doing per user ? what does your cloud code do ?
Plus: I turn off console logging for production, I use a custom logging adapter, but i guess you can edit this somehow here Line44

Many different things could cause your server to slow down if after doing 1,2,3 the problem remains, then i think this could be considered an issue with parse-server.

[Samigos]

@georgesjamous Thanks for the answer! It'll really help me a lot!

Quick question though, about your second suggestion. I'm not sure how it's done, but I think pm2 is a way to do it, right? If so, I think I've read somewhere @flovilmart writing that we shouldn't run parse server on pm2...

@flovilmart Could you please elaborate on that?

[flovilmart]

Well pm2 is a process manager. If you’re using anything else than Ec2, you should not use that.

[flovilmart]

Also, you don’t need pm2 to run parse in cluster mode. There’s a —cluster option on parse-server CLI.

[Samigos]

I know that pm2 is one of the best!! Is there a specific reason that we shouldn't use it with parse server?

[flovilmart]

@Samigos PM2 is one of the best what?

[Samigos]

As a process manager and a clustering solution... I've seen people recommending it many times! (not for parse servers specifically)

So what's the reason I shouldn't use it?

[flovilmart]

So what's the reason I shouldn't use it?

Read again what I posted above. UNLESS you are deploying to your own EC2 / Google Cloud Compute etc.. you don't need PM2. for example: elastic beanstalk, docker (most cases), heroku, Google app engine, Kubernetes and more.

So again, unless you know why you're using PM2, you should probably not use it. Also this is getting off topic, so I'll be closing this.