I've considered whether our current transformer-based AI could be conscious, as I understand it, which I deem to include some degree of self awareness combined with some degree of external awareness. I can see how theoretically something could be self aware without any external awareness, but I grasp at straws when I try to envision what that experience could be like.

In either event, I think transformer-based AI can only be conscious during the act of inference. If that's the case, then the experience of consciousness that the AI is subjected to must be the content of the tokens in the context window and the activated weights. Maybe that's reason enough to be polite to our agents?