Edit2: probably solved. I didn’t understand that Brown is talking about Neo and Trinity’s attack.
Agent Smith is questioning Morpheus, trying to extract the codes to the Zion mainframe. Neo and Trinity have attacked the building in which Morpheus is being held, trying to save him.
(Office)
Agent Jones: What were you doing?
Agent Brown: He doesn’t know.
Agent Smith: Know what?
It feels too poignant to have a machine say this without there being something else to it.
Edit: what I mean is, a machine wouldn’t “retort” or be passive aggressive like this.
I like to think Agent Smith took out the ear piece because he was confessing he hates it inside the Matrix, ie he was becoming more human in his own little misanthropic way.
It will absolutely fitting with the wackovski’s vision and what they have said about the Matrix world