For example the user can enter: +444123454656656 OR 123454656656 - only numbers or a + in front of the number.
<TextFieldFormsy
className="myclasse"
variant="outlined"
label={t("phone_number")}
id="phone_number"
name="phone_number"
value={phone_number}
onChange={handleChange}
/>
You can simply filter the input in onChange to remove everyting you do not want:
here is a fiddle for the filter.