Dynamic Mautic segments will be created by a certain filter. For instance: it could be defined by a certain tag a contact has been added. What happens, if you remove this contact from the segment manually? Will it be added again with the next segment update, as the contact still holds the defined tag?

No! A contact that has been removed from the dynamic segment will not be re-added again automatically (tested with autic 2.16.2)