After use Custom Authorization in power bi report server in Row level security part cannot assign group of database And also I checked the codes of Authorization.cs, AuthenticationUtilities.cs and AuthenticationExtension.cs classes, I didn't find a method related to Row level security that I can develop.
I was able to develop the security part that checks the permission of each report based on the group and users of my database, but I ran into trouble in the Row level security part and I did not find a method to develop.
https://github.com/microsoft/Reporting-Services/issues/188
and
Row-level security (RLS) in Power BI Report Server
So in your model you set up RLS rules based on the username format you passed from your custom auth extension.