Of course there's a ton of data corresponding to things that aren't shown on the screen display! A monster that's behind a closed door still exists. It isn't generated at the moment you open the door.Demarquis wrote: ↑Thu Jan 13, 2022 6:17 pmThat Doom playing bot appears to be an example of what I am describing: the bots play the game using the visual information from the screen (which is displaying the game Doom). They would pretty much have to do this, because, while I am not a programmer and do not have access to the developer notes for the game, there isn't any reason for the Doom software to be creating any data that isn't translated into the screen display. Why would it?
Typically, game bots work by simply knowing stuff. They don't usually waste processing power on rendering a scene for the bot and then interpreting it, they just let the bots access directly the coordinates of everything. Basically, all bots use wallhacks. This particular example I shown doesn't do that because there the aim of the exercise is precisely to work on the visual interpretation AI side of things.
What I'm talking about, then, is that there's a question of perception. Even though it's machine vision with sensor data fusion for raw data from radar, IRST, optronics and whatever else, in the real world you don't get to have immediate access to perfect knowledge, like a bot can when it just reads data value from a simulation. Instead, we gotta work with the filter of perception. We get input, whether from our retinas or from a T/R module, and we gotta interpret it. And that input can be misleading in all kinds of ways. For example one of the problems they had to solve with sensor data fusion on the F-35 was duplication. One track gives you an aircraft at position X, another track gives you an aircraft at position Y, the two positions overlap, the unwanted outcome is two separate aircraft clipping through each other. You've got to deal with electronic warfare (jamming, spoofing, etc.) and stealth. You've got to deal with blind spots in your sensors. You've got to deal with a lot of problems like this because you can't read God's RAM.
