Increased memory consumption after upgrading from v3.7.x to v4.2
-
Hey, so after the upgrade the memory consumption has been creeping up at a fairly steady rate and exceeding 1GB of memory. Is this something to be expected from the version upgrade? Or could it be due to our own changes / plugins we have? Or due to scrapers perhaps?
Upgrade happened on Monday 14th and before that the memory consumption was fairly steady at around 500MB. After the upgrade the memory consumption has been steadily going up during the day as seen in the pictures:
Screenshot when the sudden increase was noticed:
Here is last 7 days: (the falling edges are due to daily restart)
Screenshot from the /admin/development/info on the 23rd when it started also using swap.
Active plugins:
* nodebb-plugin-s3-uploads@3.0.5 (installed, enabled)
* nodebb-plugin-2factor@7.5.9 (installed, disabled)
* nodebb-plugin-composer-default@10.2.47 (installed, enabled)
* nodebb-plugin-dbsearch@6.2.13 (installed, enabled)
* nodebb-plugin-emoji@6.0.2 (installed, disabled)
* nodebb-plugin-emoji-android@4.1.1 (installed, disabled)
* nodebb-plugin-gravatar@4.0.0 (installed, enabled)
* nodebb-plugin-markdown@13.1.1 (installed, enabled)
* nodebb-plugin-mentions@4.7.1 (installed, enabled)
* nodebb-plugin-poll@3.2.5 (installed, disabled)
* nodebb-plugin-question-and-answer@1.2.7 (installed, enabled)
* nodebb-plugin-spam-be-gone@2.3.1 (installed, enabled)
* nodebb-plugin-sso-custom@1.0.0 (installed, enabled)
* nodebb-plugin-web-push@0.7.3 (installed, disabled)
* nodebb-plugin-write-api-custom@5.8.12 (installed, enabled)
* nodebb-rewards-essentials@1.0.1 (installed, enabled)
* nodebb-theme-harmony@2.0.40 (installed, disabled)
* nodebb-theme-lavender@7.1.18 (installed, disabled)
* nodebb-theme-peace@2.2.39 (installed, disabled)
* nodebb-theme-persona@14.0.16 (installed, disabled)
* nodebb-theme-custom@1.0.0 (installed, enabled)
* nodebb-widget-essentials@7.0.36 (installed, enabled)Nginx is being used to serve static assets and the config is the same as it was before the upgrade.
Setup:
Mongodb Atlas M40
Redis is Heroku's own key value store premium 2
Heroku -> 4 dynos (Standard-2X variant)
In one dyno we have nginx + nodebbAny help would be greatly appreciated!
Thanks in advance. -
Hey, so after the upgrade the memory consumption has been creeping up at a fairly steady rate and exceeding 1GB of memory. Is this something to be expected from the version upgrade? Or could it be due to our own changes / plugins we have? Or due to scrapers perhaps?
Upgrade happened on Monday 14th and before that the memory consumption was fairly steady at around 500MB. After the upgrade the memory consumption has been steadily going up during the day as seen in the pictures:
Screenshot when the sudden increase was noticed:
Here is last 7 days: (the falling edges are due to daily restart)
Screenshot from the /admin/development/info on the 23rd when it started also using swap.
Active plugins:
* nodebb-plugin-s3-uploads@3.0.5 (installed, enabled)
* nodebb-plugin-2factor@7.5.9 (installed, disabled)
* nodebb-plugin-composer-default@10.2.47 (installed, enabled)
* nodebb-plugin-dbsearch@6.2.13 (installed, enabled)
* nodebb-plugin-emoji@6.0.2 (installed, disabled)
* nodebb-plugin-emoji-android@4.1.1 (installed, disabled)
* nodebb-plugin-gravatar@4.0.0 (installed, enabled)
* nodebb-plugin-markdown@13.1.1 (installed, enabled)
* nodebb-plugin-mentions@4.7.1 (installed, enabled)
* nodebb-plugin-poll@3.2.5 (installed, disabled)
* nodebb-plugin-question-and-answer@1.2.7 (installed, enabled)
* nodebb-plugin-spam-be-gone@2.3.1 (installed, enabled)
* nodebb-plugin-sso-custom@1.0.0 (installed, enabled)
* nodebb-plugin-web-push@0.7.3 (installed, disabled)
* nodebb-plugin-write-api-custom@5.8.12 (installed, enabled)
* nodebb-rewards-essentials@1.0.1 (installed, enabled)
* nodebb-theme-harmony@2.0.40 (installed, disabled)
* nodebb-theme-lavender@7.1.18 (installed, disabled)
* nodebb-theme-peace@2.2.39 (installed, disabled)
* nodebb-theme-persona@14.0.16 (installed, disabled)
* nodebb-theme-custom@1.0.0 (installed, enabled)
* nodebb-widget-essentials@7.0.36 (installed, enabled)Nginx is being used to serve static assets and the config is the same as it was before the upgrade.
Setup:
Mongodb Atlas M40
Redis is Heroku's own key value store premium 2
Heroku -> 4 dynos (Standard-2X variant)
In one dyno we have nginx + nodebbAny help would be greatly appreciated!
Thanks in advance.I would disable the daily restarts to see if the memory usage keeps going up or stabilizes.
-
Hey, so after the upgrade the memory consumption has been creeping up at a fairly steady rate and exceeding 1GB of memory. Is this something to be expected from the version upgrade? Or could it be due to our own changes / plugins we have? Or due to scrapers perhaps?
Upgrade happened on Monday 14th and before that the memory consumption was fairly steady at around 500MB. After the upgrade the memory consumption has been steadily going up during the day as seen in the pictures:
Screenshot when the sudden increase was noticed:
Here is last 7 days: (the falling edges are due to daily restart)
Screenshot from the /admin/development/info on the 23rd when it started also using swap.
Active plugins:
* nodebb-plugin-s3-uploads@3.0.5 (installed, enabled)
* nodebb-plugin-2factor@7.5.9 (installed, disabled)
* nodebb-plugin-composer-default@10.2.47 (installed, enabled)
* nodebb-plugin-dbsearch@6.2.13 (installed, enabled)
* nodebb-plugin-emoji@6.0.2 (installed, disabled)
* nodebb-plugin-emoji-android@4.1.1 (installed, disabled)
* nodebb-plugin-gravatar@4.0.0 (installed, enabled)
* nodebb-plugin-markdown@13.1.1 (installed, enabled)
* nodebb-plugin-mentions@4.7.1 (installed, enabled)
* nodebb-plugin-poll@3.2.5 (installed, disabled)
* nodebb-plugin-question-and-answer@1.2.7 (installed, enabled)
* nodebb-plugin-spam-be-gone@2.3.1 (installed, enabled)
* nodebb-plugin-sso-custom@1.0.0 (installed, enabled)
* nodebb-plugin-web-push@0.7.3 (installed, disabled)
* nodebb-plugin-write-api-custom@5.8.12 (installed, enabled)
* nodebb-rewards-essentials@1.0.1 (installed, enabled)
* nodebb-theme-harmony@2.0.40 (installed, disabled)
* nodebb-theme-lavender@7.1.18 (installed, disabled)
* nodebb-theme-peace@2.2.39 (installed, disabled)
* nodebb-theme-persona@14.0.16 (installed, disabled)
* nodebb-theme-custom@1.0.0 (installed, enabled)
* nodebb-widget-essentials@7.0.36 (installed, enabled)Nginx is being used to serve static assets and the config is the same as it was before the upgrade.
Setup:
Mongodb Atlas M40
Redis is Heroku's own key value store premium 2
Heroku -> 4 dynos (Standard-2X variant)
In one dyno we have nginx + nodebbAny help would be greatly appreciated!
Thanks in advance.I can't disable it. The auto restart is a feature from our hosting provider
-
Hey, so after the upgrade the memory consumption has been creeping up at a fairly steady rate and exceeding 1GB of memory. Is this something to be expected from the version upgrade? Or could it be due to our own changes / plugins we have? Or due to scrapers perhaps?
Upgrade happened on Monday 14th and before that the memory consumption was fairly steady at around 500MB. After the upgrade the memory consumption has been steadily going up during the day as seen in the pictures:
Screenshot when the sudden increase was noticed:
Here is last 7 days: (the falling edges are due to daily restart)
Screenshot from the /admin/development/info on the 23rd when it started also using swap.
Active plugins:
* nodebb-plugin-s3-uploads@3.0.5 (installed, enabled)
* nodebb-plugin-2factor@7.5.9 (installed, disabled)
* nodebb-plugin-composer-default@10.2.47 (installed, enabled)
* nodebb-plugin-dbsearch@6.2.13 (installed, enabled)
* nodebb-plugin-emoji@6.0.2 (installed, disabled)
* nodebb-plugin-emoji-android@4.1.1 (installed, disabled)
* nodebb-plugin-gravatar@4.0.0 (installed, enabled)
* nodebb-plugin-markdown@13.1.1 (installed, enabled)
* nodebb-plugin-mentions@4.7.1 (installed, enabled)
* nodebb-plugin-poll@3.2.5 (installed, disabled)
* nodebb-plugin-question-and-answer@1.2.7 (installed, enabled)
* nodebb-plugin-spam-be-gone@2.3.1 (installed, enabled)
* nodebb-plugin-sso-custom@1.0.0 (installed, enabled)
* nodebb-plugin-web-push@0.7.3 (installed, disabled)
* nodebb-plugin-write-api-custom@5.8.12 (installed, enabled)
* nodebb-rewards-essentials@1.0.1 (installed, enabled)
* nodebb-theme-harmony@2.0.40 (installed, disabled)
* nodebb-theme-lavender@7.1.18 (installed, disabled)
* nodebb-theme-peace@2.2.39 (installed, disabled)
* nodebb-theme-persona@14.0.16 (installed, disabled)
* nodebb-theme-custom@1.0.0 (installed, enabled)
* nodebb-widget-essentials@7.0.36 (installed, enabled)Nginx is being used to serve static assets and the config is the same as it was before the upgrade.
Setup:
Mongodb Atlas M40
Redis is Heroku's own key value store premium 2
Heroku -> 4 dynos (Standard-2X variant)
In one dyno we have nginx + nodebbAny help would be greatly appreciated!
Thanks in advance.Are you using the ActivityPub functionality? It might be related to that if only because that's what's new (among other smaller items) in v4.
If you toggle the global activitypub switch off, does that make memory usage stabilize?
Keep in mind that since you upgraded, ActivityPub is automatically disabled, so perhaps this is unrelated.