The inputs from everything Nvidia has said, are simply the final pixel colour values and motion vector information. It’s meant to sit in the same post-processing stack as the upscale. It’s effectively a screen-space post-processing filter over the final image. Nvidia have said that the artist controls are masking (blocking certain areas from it), intensity (so a slider value), and some kind of colour re-grading (since it destroys the original grading). It’s extremely limited.
Comment on Developers Were Left in the Dark About DLSS 5
PlzGivHugs@sh.itjust.works 2 weeks agoFrom my understanding, it may be possible to work around some of this, since the program is meant to hook into the game in a number of different ways. Its very possible that an “importance” mask could be added as in input, for example. This wouldn’t fix everything, but would still give a way to separate game elements from environmental details.
That said, theres been so much focus on how it looks. IMO, its completely overblown, especially when all of this needs to be manually configued on a game-by-game basis. Devs can tweak the settings to their own preferences, and make things more or less extreme.
The part thats much more worthwhile of mockery is the fact that they’re demoing a consumer product on professional grade hardware, during a hardware shortage. They couldn’t even get the demo working on a high-end gaming PC, and they think this tech is worth advertising? That is the funny part of all this.
nightlily@leminal.space 2 weeks ago
cheat700000007@lemmy.world 2 weeks ago
And Nvidia are full of shit judging from how it clearly changes geometry in the demos, women’s faces in particular
PlzGivHugs@sh.itjust.works 2 weeks ago
The inputs from everything Nvidia has said, are simply the final pixel colour values and motion vector information.
If it is the same as DLSS 4 Super Resolution, it seems to use motion vectors, colour buffers, depth buffers, and camera information like exposure. That said, this might change, as, like I said, they’re showing off something they haven’t even got running on the target hardware. Its clearly not even close to being a finished product.
nightlily@leminal.space 2 weeks ago
A tech YouTuber ended up following up with Nvidia engineers directly and it’s exactly like I said. Not even the depth buffer is part of the inputs.
PlzGivHugs@sh.itjust.works 2 weeks ago
Watched through the video, and you’re right. Based on the video, Nvidia’s original statements were, for all intents and purposes, lies. Ironically, since it does seem to be based on the existing DLSS stack (from what I’ve seen), it does have access to things like depth map, it just doesn’t use it. I’ll edit my prior comments.
That said, as I originally said, none of this matters anyway. This technology doesn’t run on desktop hardware. They announced a “”“gaming”“” software that can’t run on gaming hardware. It doesn’t matter what it looks like, because you can’t play games with it. Frankly, at this point, I doubt they’ll even release it.
ech@lemmy.ca 2 weeks ago
It’s wild that every defense of this garbage is “Just have devs spend even more time finetuning for this.” Yes, let’s double (or more) the workload of workers that are already overworked and crunched beyond reason, all for a “feature” that looks like garbage in it’s showcase demo and is so resource intensive that very few users will be able to utilize it, if they even want to.
PlzGivHugs@sh.itjust.works 2 weeks ago
Its more an argument against the, “artisit’s intent” and “disrupting gameplay” points. As I said, the feature is dumb not because it “looks like AI”.
Do you have any evidence for this? Given whats been shown, this seems relatively easy to implement on the game dev side.
Quetzalcutlass@lemmy.world 2 weeks ago
Even if implementing it turns out to be trivial, testing art assets for quality and consistency will be a nightmare. Especially if the underlying generative AI isn’t deterministic.
Katana314@lemmy.world 2 weeks ago
Even if implementing it is trivial, it’s also still “one more thing”. Just like optimizing for the Steam Deck, considering features that might not be on the lowest-tier console release, accessibility requirements, and dozens of other checklist items that might go further and further down the list. Worse, if DLSS ends up interfering with those other checklist items after it’s already been verified.
PlzGivHugs@sh.itjust.works 2 weeks ago
Yes, depending on implementation details. I mean, its never going to be completely consistant, but I don’t expect these companies to mind a little brand damage if they get short-term boost in invest.
I’m more thinking that as it stands, the hardware requirements make it DOA for users. They’re saying they’ll improve it, although I have my doubts. That said, even if no one can run it, it may be popular among publishers for screenshots and marketing. On the other hand, if it does actually double dev costs, then it’ll be DOA even for corporate use.