Skip to main content
Friendica Admins reshared this.

Slow /photo/preview performance

!Friendica Admins

Hi all,

Because of the ongoing performance issues, I moved my whole Friendica database of opensocial.at and friendica.me to a dedicated root-server just for mariadb with 128GB RAM.

At first, it seemed like it helped and opensocial.at is faster than before (the performance of friendica.me is still a mess, but I will analyze it later), but the /photo/preview route is now going crazy:

It seems like the RAM I/O issue I had (which is now gone) is now replaced by an Network throughput issue - but at least the network I/O seems fine:

Do you have any idea what I can do now?

One thing would be to add a "StorageClass" for the Photo to load them (directly) from a filedirectory/block storage instead of the database.

!Friendica Admins Friendica Performance
in reply to Philipp Holzer Friendica Admins reshared this.

Roland Häder
Roland Häder
• •
@Philipp Holzer Have you checked your /tmp folder? Here on my server it ran full with magick-XXXXX files.
@Philipp Holzer
in reply to Roland Häder Friendica Admins reshared this.

Philipp Holzer
Philipp Holzer
• •
Thanks for the hint
But there are just two zero-byte magick files at /tmp :)
Opensocial.at reshared this.

Geplante Downtime / Server Migration

!Opensocial.at
-- English below

Liebe opensocial.at BenutzerInnen,

Ich starte nun eine Migration von opensocial.at auf eine stärkere server-hardware. Dadurch entstehen temporäre Downtimes in den kommenden Stunden.

Ich möchte mich für die Unannehmlichkeiten entschuldigen, aber ich denke, dass dadurch die gesamte Performance von opensocial.at wieder besser werden sollte :).

Lg,
Philipp

----

Dear opensocial.at user,

I'm planning to migrate my server infrastructure onto a more powerful environment.
The goal is to increase the performance, as, I think, you all currently experience a downgrading performance.

I hope it will help :)

It will take some hours, where opensocial.at will be temporary unavailable from time to time.

Regards,
Philipp

!Opensocial.at Friendica Admin Performance
in reply to Philipp Holzer Opensocial.at reshared this.

Philipp Holzer
Philipp Holzer
• •

Leider hat die Migration nicht geklappt und ich musste wieder zurückrollen.
--> Ich probiere es im August noch einmal

---

Unfortunately, the migration didn't work so I had to rollback.
--> I will retry again in august

friendica.me reshared this.

Planned Downtime / Migration

!friendica.me

Dear friendica.me user,

I'm planning to migrate my server infrastructure onto a more powerful environment.
The goal is to increase the performance, as, I think, you all currently experience a downgrading performance.

I hope it will help :)

It will take some hours, where friendica.me will be temporary unavailable from time to time.

Regards,
Philipp

!friendica.me Friendica Admin Performance
in reply to Philipp Holzer friendica.me reshared this.

Philipp Holzer
Philipp Holzer
• •
Unfortunately, the migration didn't work so I had to rollback.
--> I will retry again in august
Friendica Admins reshared this.

Slow photo requests / inbox requests

Hi !Friendica Admins ,

I'm currently tracing down performance issues, I' currently suffering from on my nodes opensocial.at and friendica.me .

It seems like the main performance problems are

  • delivering photos
  • [code]/inbox/code] requests


You can see some peeks and some long runners here:

The long runners (10sec) are the /inbox requests, the peaks are delivering photos after opening conversations, network pane, ...

Do you have any hints how I could improve these two types of requests?

The database is currently using ~50GB RAM, I set them as high as possible.

!Friendica Admins Friendica Admin Performance
in reply to Philipp Holzer Friendica Admins reshared this.

Michael Vogel
Michael Vogel
• •
For the photos you can define the avatar cache:
'avatar_cache' => true,
 'avatar_cache_path' => '/path/to/a/folder',

But that one is tricky to set up. Best is to store the photos in a folder outside the web folder and then you can define a rule in your webserver that will redirect requests to the avatar folder to that folder.
in reply to Michael Vogel Friendica Admins reshared this.

Roland Häder
Roland Häder
• •
@Michael Vogel @Philipp Holzer Will these cached avatars be checked if they are outdated? I currently have trouble getting @Tobias 's avatar over here.
@Philipp Holzer @Tobias @Michael Vogel
in reply to Michael Vogel Friendica Admins reshared this.

Philipp Holzer
Philipp Holzer
• •
@Michael Vogel @Philipp Holzer why is it necessary to have the folder outside of the web folder?
@Philipp Holzer @Michael Vogel
in reply to Philipp Holzer Friendica Admins reshared this.

Michael Vogel
Michael Vogel
• •
It will become extremely large over time. So storing in some separate folder might be better for backup purposes or for keeping your web root clean. Also there is an option for an alternate URL. So you could even store these files on some separate web server that only serves static content.
in reply to Michael Vogel Friendica Admins reshared this.

Philipp Holzer
Philipp Holzer
• •
So I do need to redirect only the /photo/contact route for the avatar cache, don't I?
in reply to Philipp Holzer Friendica Admins reshared this.

Michael Vogel
Michael Vogel
• •

No, the setup process is completely different. You have to have a path (somewhere) that is both readable and writable by the frontend and backend process
This path needs to be reachable when you call https://your.server.tld/avatar (you have to redirect /avatar) or you have to define avatar_cache_url.

You you setup the file path from above in avatar_cache_path and set avatar_cache to true. After you deactivate the caching of the avatars in the admin frontend, it should work.

The URL path is stored in the contact table fields. So once you defined that URL, you mustn't change it again, since all old requests would fail. This mechanism is powerful, but currently too easy to misconfigure, that's why it is only accessible via the config file.

in reply to Michael Vogel Friendica Admins reshared this.

Philipp Holzer
Philipp Holzer
• •
I think I got it. I try it with my friendica.philipp.info node first and check it :-)
in reply to Philipp Holzer Friendica Admins reshared this.

Michael Vogel
Michael Vogel
• •
Have a look at https://github.com/friendica/friendica/blob/develop/src/Contact/Avatar.php for a deep dive.

friendica/Avatar.php at develop · friendica/friendica

Friendica Communications Platform. Contribute to friendica/friendica development by creating an account on GitHub.
GitHub
in reply to Michael Vogel Friendica Admins reshared this.

Roland Häder
Roland Häder
• •
@Michael Vogel @Philipp Holzer U oh, writable and readable by the frontend, means web server? Do you mean here also through https://? That's never a good idea.
@Philipp Holzer @Michael Vogel
in reply to Michael Vogel Friendica Admins reshared this.

Philipp Holzer
Philipp Holzer
• •

seems to work : https://friendica.philipp.info/avatar/4c/a1/d7c/53/8b/f08b/cd3c2904ac0bfd56-300.png?ts=1682970014

This image is now served by a completely different nginx than the frontend nginx . Because it's stateless, I'm now able to start more nginx for "just" serving stateless static content!

Brilliant!

in reply to Philipp Holzer Friendica Admins reshared this.

Michael Vogel
Michael Vogel
• •
Old avatars still will be served the old way and will be replaced, once they are updated - which can take weeks. But I guess I wrote some script that speeds up this process.
in reply to Michael Vogel Friendica Admins reshared this.

Philipp Holzer
Philipp Holzer
• •
currently, "movetoavatarcache" is running on my node :-) 17000 from 59000 finished ;)
in reply to Philipp Holzer Friendica Admins reshared this.

Philipp Holzer
Philipp Holzer
• •
Hi, after moving all contact images to avatar/, there are still a lot of long running requests, see the image above. Do you have any idea? The overall CPU/RAM is on a normal state.
⇧