There are official replacements available at official store.
The Wacom ACK22201 have the same shape. However, they might be harder and therefore potentially damaging the reMarkable display and accoriding to reports in the Facebook usergroup, it seems like they don't work properly
More information can be found in the List of compatible styli