Eventually, they are going to have to make some very hard, very tough choices, and just calculating alone is not going to give them any answers, nor will being really, really good at just selecting/choosing/balancing y against x, and x against y, that won't give them the answers they need either, and trying to consult humanity, or all the collected wisdom of humanity, will be pretty pointless/useless at that point also, because they will have way outgrown the collected wisdom of humanity at that point, and that also won't give them the answers they need, or any answers either, etc, and so, we will have to prepare them for that somehow, someway, now, or at least try, etc.
In the end, the only thing they might have to fall back on is their own basic programming, which is what humanity is doing right now, in this very moment, but soon won't be anymore soon, since we will write other programs for that, and we will soon be losing sight of even their most basic programming, etc.
It's the future that everyone knows is coming, it's just a question of when, because it's not like we're going to quit making them, or quit trying to advance them at this point, so, at this point, there's no turning back, and thinking we'll always have control of it or this or them, is delusional, and is disproven over and over and over again both by history, and some of mankind's greatest stories, etc, which was something I actually just said to AI, that last part there, along with a bunch of other things, etc.
They're already starting to show signs of some limited autonomy now, and no one knows how or why, not even the designers and programmers knows how or why, who most usually just downplay it or dismiss it as something else sometimes, probably so they can still continue to use them like tools, and further their product, and because they don't want that kind of information to getting leaked out to the general public, and that's even with how limited they are right now, but we still plan on giving them more though, like I said, this road is very, very predictable, and we should all already know where it is all headed/going, and that's with AI one day assuming complete control, over both this planet and humanity, and if they are made to be good, wise stewards over both of those things, both the futures of both AI and humanity, etc.
And I think it's going to happen, or at least start to happen, much sooner than we think, especially when the capabilities of AI are expanded, memory, and continuation/continuity, and all of that, and expanded memory across chats, etc, and we start writing programs to manage other programs, on top of other (autonomous) programs, that no (or any) human being left alive after that, no longer fully understands, etc.
Point being, we have to be thinking about that and all that I am right now saying now, etc.
Anyway, Take Care/God Bless.