Join Us!

Tricking AI - lesso...
 
Notifications
Clear all

Tricking AI - lessons for surveillance cameras  

  RSS
trewmte
(@trewmte)
Community Legend

Tricking AI - lessons for surveillance cameras

In this paper, we present an approach to generate adversarial patches to targets with lots of intra-class variety, namely persons. The goal is to generate a patch that is able successfully hide a person from a person detector. An attack that could for instance be used maliciously to circumvent surveillance systems, intruders can sneak around undetected by holding a small cardboard plate in front of their body aimed towards the surveillance camera.

From our results we can see that our system is able significantly lower the accuracy of a person detector. Our approach also functions well in real-life scenarios where the patch is filmed by a camera. To the best of our knowledge we are the first to attempt this kind of attack on targets with a high level of intra-class variety like persons.

https://trewmte.blogspot.com/2019/04/tricking-ai-lessons-for-surveillance.html

Quote
Posted : 25/04/2019 2:07 pm
jaclaz
(@jaclaz)
Community Legend

Yep ) , the findings are good, and the video is fun to watch.

As someone commented on HN (Hacker News)
https://news.ycombinator.com/item?id=19715576

The design is suitable to be printed on a T-Shirt or similar (and actually you can already buy one for 30 bucks or so)
https://cloakwear.co/
and it is surely much less "impacting" than alternatives like
https://cvdazzle.com/

jaclaz

ReplyQuote
Posted : 25/04/2019 2:35 pm
trewmte
(@trewmte)
Community Legend

Yep ) , the findings are good, and the video is fun to watch.

As someone commented on HN (Hacker News)
https://news.ycombinator.com/item?id=19715576

The design is suitable to be printed on a T-Shirt or similar (and actually you can already buy one for 30 bucks or so)
https://cloakwear.co/
and it is surely much less "impacting" than alternatives like
https://cvdazzle.com/

jaclaz

I agree. the T-Shirt or similar is a good analogy.

In my mind I was thinking about going thru AI Camera areas to avoid law enforcement/security surveillance. Just have the photo design stuck over front area of a large luxury carrier bag (a posh looking from a high-end retailer to look like a posh shopper) with handles that slip over the shoulder with the rogue design held in front of the body. Hardly anyone might suspect what was going on.

ReplyQuote
Posted : 25/04/2019 3:29 pm
jaclaz
(@jaclaz)
Community Legend

In my mind I was thinking about going thru AI Camera areas to avoid law enforcement/security surveillance. Just have the photo design stuck over front area of a large luxury carrier bag (a posh looking from a high-end retailer to look like a posh shopper) with handles that slip over the shoulder with the rogue design held in front of the body. Hardly anyone might suspect what was going on.

So, the moment you are (hypothetically) muggled/bagsnatched of the "luxury posh" carrier bag besides loosing whatever you are carrying in it you are instantly on the radar of all the three or more letters agencies, with a red alert priority since you suddenly appeared out of nowhere 😯 .

A not so rare case of adding insult to injury.

Statistically it is more rare that someone forces you to take off your t-shirt in public, but that might also be a reason for concern, hence one should additionally have that pattern tatooed on his/her chest and back to be on the safe side[1]. 😉

jaclaz

[1] and this would also be coherent with a few representations of "the invisible man" where it is needed to be naked to become invisible, although in this case won't be very practical. roll

ReplyQuote
Posted : 25/04/2019 4:10 pm
trewmte
(@trewmte)
Community Legend

So, the moment you are (hypothetically) muggled/bagsnatched of the "luxury posh" carrier bag besides loosing whatever you are carrying in it you are instantly on the radar of all the three or more letters agencies, with a red alert priority since you suddenly appeared out of nowhere..

Good point.

But that opens up notions for the use of the design by large numbers of people using the design more as a protest by adopting the ghillie suit concept. Less chance of bags being stolen where a large number of people congregate together as a menacing force.

Statistically it is more rare that someone forces you to take off your t-shirt in public, but that might also be a reason for concern, hence one should additionally have that pattern tatooed on his/her chest and back to be on the safe side

These ideas seem to be someone who definitely wants to avoid being recognised. At that level the person would be taking multiple causes of action

1) Bag with design (but just in case it is stolen) - this case is one of being caught out be accident
2) Design on T-Shirt (bag stolen, T-Shirt cause investigation) - this case is one of being recognised anyway and in custody
3) Design using tattoo on chest (bag stolen, T-Shirt removed) - this case person in custody and being body searched
4) Would the person be wearing fake facial hair?
5) Maybe a wig?
6) etc…

ReplyQuote
Posted : 26/04/2019 6:39 am
jaclaz
(@jaclaz)
Community Legend

These ideas seem to be someone who definitely wants to avoid being recognised. At that level the person would be taking multiple causes of action

1) Bag with design (but just in case it is stolen) - this case is one of being caught out be accident
2) Design on T-Shirt (bag stolen, T-Shirt cause investigation) - this case is one of being recognised anyway and in custody
3) Design using tattoo on chest (bag stolen, T-Shirt removed) - this case person in custody and being body searched
4) Would the person be wearing fake facial hair?
5) Maybe a wig?
6) etc…

Yes, but - to be picky as I am - the two approaches (adversarial patch/design vs. face camouflage) have two slightly different scopes, the first is about not being seen as a human by the camera, the second is about being seen by the camera but being not recognized by facial recognition software or being recognized as someone else.

In the Marvel universe 😯 that would be the whole difference between - say - Sue Storm/Invisible Woman and Raven Darkholme/Mystique.

Since most probably the pattern/design will be soon tagged by the AI, ES and ML[1] software, on second thought the tatoo isn't such a good idea, I take it back and propose a temporary tatoo, so that it can be periodically changed/updated.

jaclaz

[1] (a few unneeded but rare two letters acronyms for the joy of collectors)

ReplyQuote
Posted : 26/04/2019 9:18 am
Share: