No, it works just like other similar passives (Fiddlesticks old passive, Irelia passive, etc; these would reveal CHAMPIONS you couldn't see). Since the enemy team can "see" you, the damage buff icon has to disappear after 4 seconds of being seen. Since you're obviously not being seen by a champion or minion, you know it's a ward.