I am trying to create synthetic data with unreal engine. I want to fly a drone(with AirSim or anything else) and capture IR images. as its for teaching a neural network, I need a real good IR vision images. I mean just a texture with red color and orange color respecting the corners(like another tutorials in the net) is not as good as I want. AirSim it self has a IR vision but its something like grayscale and its not good as it should be. can you please Help me doing this :)?
No difference, UE4 or UE5 or even unity! I just need the simulation (even in paint :D)
I was thinking about setting a variable Temperature for every single object in my scene and using this to convert the RGB to IR but idk it is good or not. also if you know some material or object available in the market that will capture IR vision images it will be nice if you tell me about it.
This doesn't require simulation as such.
This requires you to come up with textures that represent the temperature (thermal emissions) of the entities you care about. That'll be accurate enough.
All the geometry would just be mapped a texture, but no lighting at all, just texture. Or not even a texture, just a temperature per vertex, for simple objects.
If you want to go overboard, come up with several textures per entity, say one for resting metabolism and one for strenuous activity. Or typical thermal signatures for typical weather patterns and seasons. I'm sure deer vary in that regard. For simple objects, you can skip textures and just give the vertices a temperature. Ground/soil/rocks may be warmer or colder than plants, depending on above-mentioned factors.
Those textures/temperatures ought to be grayscale. Grayscale thermal is data. It's directly related to the actual temperature. False-color isn't data, it's illustration. Do not ever feed false-color (illustrations) into any processing.
A deer's visible-color "texture" is fairly uncorrelated with its thermal "texture". You can't take a regular color deer texture and derive a thermal texture from that.
You'll want to get an artist to make up those textures for you. In grayscale of course. You ought to define the scale initially, and adjust any reference pictures to match that scale. Then you can hope to get accurate representations. You should come up with detailed reference thermal images, always grayscale with scale bar, that capture all angles of the model you care about.
Link dump: