Thank you all for your input!
I connected the PC directly to the router and the package loss seemed to vanish. I put back all cables and hardware in between step by step and checked. It seems, my Netgear Switch (netgear prosafe gs108e v3) seems to be the issue.
My setup:
Internet -> Router -> Cable -> Wall -> Cable -> Switch -> Cable -> PC
The switch has 8 ports and also has other devices connected. There is no loop.
After a factory reset of the Switch, it seemed to be fined at first. Even when re-attaching all the other ports.
However, after some hours, the package loss starts to happen again. I’m trying a firmware update right now and hope it was a bug that has been fixed. If not, I guess I need to buy another switch.
For the record, I will attach the screenshot I took from the router.
Do any of you have other ideas or recommendations on what could be the issue?
Is it normal for a switch, to just happen to start loosing packages?
Any recommendations for a better switch maybe?

Thank you for your help!