From f701e07f3a47e10c66eef831442b623df88c4597 Mon Sep 17 00:00:00 2001 From: adamhrv Date: Thu, 18 Apr 2019 23:22:51 +0200 Subject: buttons --- site/assets/css/css.css | 17 ++- site/public/about/index.html | 12 +- site/public/datasets/index.html | 10 +- site/public/datasets/msceleb/index.html | 203 +++++++++----------------------- 4 files changed, 80 insertions(+), 162 deletions(-) (limited to 'site') diff --git a/site/assets/css/css.css b/site/assets/css/css.css index e67b60d7..fa91a67f 100644 --- a/site/assets/css/css.css +++ b/site/assets/css/css.css @@ -767,7 +767,7 @@ section.fullwidth .image { display: flex; flex-direction: row; flex-wrap: wrap; - margin:0; + margin: 20px 0 0 0; } .dataset-list a { text-decoration: none; @@ -838,16 +838,23 @@ section.fullwidth .image { display: inline-block; margin: 0; cursor: pointer; - margin-right: 20px; - font-size: 16px; + margin-right: 10px; transition: background 0.2s; background: #555; color: #fff; - padding: 4px 6px; + padding: 8px 12px; border-radius: 4px; font-weight: 500; - font-size: 14px; + font-size: 11px; cursor: pointer; + user-select: none; + -moz-user-select: none; + -khtml-user-select: none; + -webkit-user-select: none; + -o-user-select: none; +} +.dataset-list .sort-options li:last-child { + margin-right:0; } .dataset-list .sort-options li.active { background: #fff; diff --git a/site/public/about/index.html b/site/public/about/index.html index b83736d3..86059e42 100644 --- a/site/public/about/index.html +++ b/site/public/about/index.html @@ -35,8 +35,7 @@
  • Legal / Privacy

    • MegaPixels is an independent art and research project by Adam Harvey and Jules LaPlace that investigates the ethics, origins, and individual privacy implications of face recognition image datasets and their role in the expansion of biometric surveillance technologies.

    -

    MegaPixels is made possible with support from Mozilla, our primary funding partner.

    -

    Additional support for MegaPixels is provided by the European ARTificial Intelligence Network (AI LAB) at the Ars Electronica Center, 1-year research-in-residence grant from Karlsruhe HfG, and sales from the Privacy Gift Shop.

    +

    This project is made possible with support from Mozilla.

    Adam Harvey

    @@ -50,11 +49,10 @@

    asdf.us

    -

    The MegaPixels website is based on an earlier installation from 2017 and ongoing research and lectures (TedX, CPDP) about facial recognition datasets. Over the last several years this project has evolved into a large-scale interrogation of hundreds of publicly-available face and person analysis datasets.

    -

    MegaPixels aims to provide a critical perspective on machine learning image datsets, one that might otherwise escape academia and the industry funded artificial intelligence think tanks that are often supported by the same technology companies who have created many of the datasets presented on this site.

    -

    MegaPixels is an independent project, designed as a public resource for educators, students, journalists, and researchers. Each dataset presented on this site undergoes a thorough review of its images, intent, and funding sources. Though the goals are similar to publishing a public academic paper, MegaPixels is a website-first reserch project aligns closley with the goals of pre-print academic publications. As such we welcome feedback and ways to improve this site and the clarity of the research.

    -

    Because this project surfaces many funding issues with datasets (from datasets funded by the C.I.A. to the National Unviversity of Defense and Technology in China), it is important that we are transparent about own funding. The original MegaPixels installation in 2017 was built as a commission for and with support from Tactical Technology Collective and Mozilla. The bulk of the research and web-development during 2018 - 2018 was supported by a grant from Mozilla. Continued development in 2019 is partially supported by a 1-year Reseacher-in-Residence grant from Karlsruhe HfG, lecture and workshop fees, and from commissions and sales from the Privacy Gift Shop.

    -

    Please get in touch if you are interested in supporting this project.

    +

    MegaPixels is an art and research project first launched in 2017 for an installation at Tactical Technology Collective's GlassRoom about facial recognition datasets. In 2018 it was extended to cover pedestrian analysis datasets for a commission by Elevate Arts festival in Austria. Since then MegaPixels has evolved into a large-scale interrogation of hundreds of publicly-available face and person analysis datasets.

    +

    MegaPixels aims to provide a critical perspective on machine learning image datsets, one that might otherwise escape academia and industry funded artificial intelligence think tanks that are often supported by the same technology companies who have created many of the datasets presented on this site.

    +

    MegaPixels is an independent project, designed as a public resource for educators, students, journalists, and researchers. Each dataset presented on this site undergoes a thorough review of its images, intent, and funding sources. Though the goals are similar to publishing a public academic paper, MegaPixels is a website-first research project.

    +

    One of the main focuses of the dataset investigations is uncovering where funding originated. Because of our empahasis on other researchers' funding sources, it is important that we are transparent about our own. This site and the past year of reserach have been primarily funded by a privacy art grant from Mozilla in 2018. The original MegaPixels installation in 2017 was built as a commission for and with support from Tactical Technology Collective and Mozilla. Continued development in 2019 is partially supported by a 1-year Reseacher-in-Residence grant from Karlsruhe HfG and lecture and workshop fees.

    Team
    • Adam Harvey: Concept, research and analysis, design, computer vision
      • diff --git a/site/public/datasets/index.html b/site/public/datasets/index.html index c6c4185a..047b6874 100644 --- a/site/public/datasets/index.html +++ b/site/public/datasets/index.html @@ -27,7 +27,7 @@
      -

      Facial Recognition Datasets

      +

      Face Recognition Datasets

      Explore publicly available facial recognition datasets feeding into research and development of biometric surveillance technologies at the largest technology companies and defense contractors in the world.

      @@ -56,7 +56,7 @@
      2016
      Person re-identification, multi-camera tracking
      2,000,000 images
      -
      1,812
      +
      2,700
    @@ -66,7 +66,7 @@ HRT Transgender Dataset
    2013
    -
    gender transition and facial recognition
    +
    Face recognition, gender transition biometrics
    10,564 images
    38
    @@ -101,10 +101,10 @@
    Oxford Town Centre
    -
    2011
    +
    2009
    Person detection, gaze estimation
    images
    -
    +
    2,200
    diff --git a/site/public/datasets/msceleb/index.html b/site/public/datasets/msceleb/index.html index c42a2767..5ed2f3a2 100644 --- a/site/public/datasets/msceleb/index.html +++ b/site/public/datasets/msceleb/index.html @@ -4,7 +4,7 @@ MegaPixels - + @@ -26,7 +26,7 @@
    -
    Microsoft Celeb 1M is a target list and dataset of web images used for research and development of face recognition technologies
    The MS Celeb dataset includes over 10 million images of about 100K people and a target list of 1 million individuals +
    Microsoft Celeb 1M is a target list and dataset of web images used for research and development of face recognition
    The MS Celeb dataset includes over 10 million images of about 100K people and a target list of 1 million individuals

    Microsoft Celeb Dataset (MS Celeb)

    Published
    @@ -49,210 +49,125 @@
    Website
    -

    Microsoft Celeb (MS Celeb) is a dataset of 10 million face images scraped from the Internet and used for research and development of large-scale biometric recognition systems. According to Microsoft Research who created and published the dataset in 2016, MS Celeb is the largest publicly available face recognition dataset in the world, containing over 10 million images of nearly 100,000 individuals. Microsoft's goal in building this dataset was to distribute the initial training dataset of 100,000 individuals images and use this to accelerate reserch into recognizing a target list of one million individuals from their face images "using all the possibly collected face images of this individual on the web as training data". 2

    -

    These one million people, defined as Micrsoft Research as "celebrities", are often merely people who must maintain an online presence for their professional lives. Microsoft's list of 1 million people is an expansive exploitation of the current reality that for many people including academics, policy makers, writers, artists, and especially journalists maintaining an online presence is mandatory and should not allow Microsoft (or anyone else) to use their biometrics for reserach and development of surveillance technology. Many of names in target list even include people critical of the very technology Microsoft is using their name and biometric information to build. The list includes digital rights activists like Jillian York and [add more]; artists critical of surveillance including Trevor Paglen, Hito Steryl, Kyle McDonald, Jill Magid, and Aram Bartholl; Intercept founders Laura Poitras, Jeremy Scahill, and Glen Greenwald; Data and Society founder danah boyd; and even Julie Brill the former FTC commissioner responsible for protecting consumer’s privacy to name a few.

    +

    Microsoft Celeb (MS Celeb) is a dataset of 10 million face images scraped from the Internet and used for research and development of large-scale biometric recognition systems. According to Microsoft Research who created and published the dataset in 2016, MS Celeb is the largest publicly available face recognition dataset in the world, containing over 10 million images of nearly 100,000 individuals. Microsoft's goal in building this dataset was to distribute an initial training dataset of 100,000 individuals images and use this to accelerate reserch into recognizing a target list of one million individuals from their face images "using all the possibly collected face images of this individual on the web as training data". 1

    +

    These one million people, defined by Micrsoft Research as "celebrities", are often merely people who must maintain an online presence for their professional lives. Microsoft's list of 1 million people is an expansive exploitation of the current reality that for many people including academics, policy makers, writers, artists, and especially journalists maintaining an online presence is mandatory and should not allow Microsoft or anyone else to use their biometrics for reserach and development of surveillance technology. Many of names in target list even include people critical of the very technology Microsoft is using their name and biometric information to build. The list includes digital rights activists like Jillian York and [add more]; artists critical of surveillance including Trevor Paglen, Hito Steryl, Jill Magid, and Aram Bartholl; Intercept founders Laura Poitras, Jeremy Scahill, and Glen Greenwald; Data and Society founder danah boyd; and even Julie Brill the former FTC commissioner responsible for protecting consumer’s privacy to name a few.

    Microsoft's 1 Million Target List

    -

    Below is a list of names that were included in list of 1 million individuals curated to illustrate Microsoft's expansive and exploitative practice of scraping the Internet for biometric training data. The entire name file can be downloaded from msceleb.org. Names appearing with * indicate that Microsoft also distributed imaged.

    -

    [ cleaning this up ]

    +

    Below is a list of names that were included in list of 1 million individuals curated to illustrate Microsoft's expansive and exploitative practice of scraping the Internet for biometric training data. The entire name file can be downloaded from msceleb.org. Email msceleb@microsoft.com to have your name removed. Names appearing with * indicate that Microsoft also distributed images.

    - - - - + - - - - - - - - - - - - - - - - - - - - - - - + + - - - - + + - - - - + + - - - - + + - - - - + + - - - - + + - - - - + + - - - - + + - - - - + + - - - - + +
    NameID ProfessionImages
    Jeremy Scahill/m/02p_8_nAdrian Chen Journalistx
    Jillian York/m/0g9_3c3Digital rights activistx
    Astra Taylor/m/05f6_39Author, activistx
    Jonathan Zittrain/m/01f75cEFF board memberno
    Julie BrillxxxAi Weiwei*Artist
    Jonathan ZittrainxxxAram BarthollInternet artist
    Bruce Schneierm.095jsCryptologist and authoryesAstra TaylorAuthor, director, activist
    Julie Brillm.0bs3s9gxxAlexander MadrigalJournlist
    Kim Zetter/m/09r4j3xxBruce Schneier*Cryptologist
    Ethan Zuckermanxxxdanah boydData & Society founder
    Jill MagidxxxEdward FeltenFormer FTC Chief Technologist
    Kyle McDonaldxxxEvgeny Morozov*Tech writer, researcher
    Trevor PaglenxxxGlen Greenwald*Journalist, author
    R. Luke DuBoisxxxHito SterylArtist, writer
    - - - - - - - - - - - - - - - - - - - - - - - - + + - - - - + + - - - - + + - - - - + + - - - - + + - - - - + + - - - - + + - - - - + + - - - - + + - - - - + + - - - - + +
    NameID ProfessionImages
    Trevor Paglenxxx
    Ai Weiwei/m/0278dyqxx
    Jer Thorp/m/01h8lgxx
    Edward Felten/m/028_7kxxJames RisenJournalist
    Evgeny Morozov/m/05sxhgdScholar and technology criticyesJeremy Scahill*Journalist
    danah boyd/m/06zmx5Data and Society founderxJill MagidArtist
    Bruce SchneierxxxJillian YorkDigital rights activist
    Laura PoitrasxxxJonathan ZittrainEFF board member
    Trevor PaglenxxxJulie BrillFormer FTC Commissioner
    Astra TaylorxxxKim ZetterJournalist, author
    Shoshanaa ZuboffxxxLaura Poitras*Filmmaker
    Eyal Weizmanm.0g54526xxLuke DuBoisArtist
    Aram Barthollm.06_wjycxxShoshana ZuboffAuthor, academic
    James Risenm.09pk6bxxTrevor PaglenArtist, researcher
    -

    After publishing this list, researchers from Microsoft Asia then worked with researchers affilliated with China's National University of Defense Technology (controlled by China's Central Military Commission) and used the the MS Celeb dataset for their research paper on using "Faces as Lighting Probes via Unsupervised Deep Highlight Extraction" with potential applications in 3D face recognition.

    -

    In an article published by the Financial Times based on data discovered during this investigation, Samm Sacks (senior fellow at New American and China tech policy expert) commented that this research raised "red flags because of the nature of the technology, the authors affilliations, combined with the what we know about how this technology is being deployed in China right now". 3

    -

    Four more papers published by SenseTime which also use the MS Celeb dataset raise similar flags. SenseTime is Beijing based company providing surveillance to Chinese authorities including [ add context here ] has been flagged as complicity in potential human rights violations.

    -

    One of the 4 SenseTime papers, "Exploring Disentangled Feature Representation Beyond Face Identification", shows how SenseTime is developing automated face analysis technology to infer race, narrow eyes, nose size, and chin size, all of which could be used to target vulnerable ethnic groups based on their facial appearances. 4

    +

    After publishing this list, researchers from Microsoft Asia then worked with researchers affiliated with China's National University of Defense Technology (controlled by China's Central Military Commission) and used the the MS Celeb dataset for their research paper on using "Faces as Lighting Probes via Unsupervised Deep Highlight Extraction" with potential applications in 3D face recognition.

    +

    In an article published by Financial Times based on data surfaced during this investigation, Samm Sacks (a senior fellow at New America think tank) commented that this research raised "red flags because of the nature of the technology, the author's affiliations, combined with what we know about how this technology is being deployed in China right now". Adding, that "the [Chinese] government is using these technologies to biuld surveillance systems and to detain minorities [in Xinjiang]". 2

    +

    Four more papers published by SenseTime which also use the MS Celeb dataset raise similar flags. SenseTime is a computer vision surveillance company who until April 2019 provided surveillance to Chinese authorities to monitor and track Uighur Muslims in Xinjiang province and had been flagged numerous times as having potential links to human rights violations.

    +

    One of the 4 SenseTime papers, "Exploring Disentangled Feature Representation Beyond Face Identification", shows how SenseTime was developing automated face analysis technology to infer race, narrow eyes, nose size, and chin size, all of which could be used to target vulnerable ethnic groups based on their facial appearances.

    Earlier in 2019, Microsoft CEO Brad Smith called for the governmental regulation of face recognition, citing the potential for misuse, a rare admission that Microsoft's surveillance-driven business model had lost its bearing. More recently Smith also announced that Microsoft would seemingly take stand against potential misuse and decided to not sell face recognition to an unnamed United States law enforcement agency, citing that their technology was not accurate enough to be used on minorities because it was trained mostly on white male faces.

    -

    What the decision to block the sale announces is not so much that Microsoft has upgraded their ethics, but that it publicly acknolwedged it can't sell a data-driven product without data. Microsoft can't sell face recognition for faces they can't train on.

    -

    Until now, that data has been freely harvested from the Internet and packaged in training sets like MS Celeb, which are overwhelmingly white and male. Without balanced data, facial recognition contains blind spots. And without datasets like MS Celeb, the powerful yet innaccurate facial recognition services like Microsoft's Azure Cognitive Service also would not be able to see at all.

    -

    Microsoft didn't only create MS Celeb for other researchers to use, they also used it internally. In a publicly available 2017 Microsoft Research project called "(One-shot Face Recognition by Promoting Underrepresented Classes)", Microsoft leveraged the MS Celeb dataset to analyse their algorithms and advertise the results. Interestingly, the Microsoft's corporate version does not mention they used the MS Celeb datset, but the open-acess version of the paper published on arxiv.org that same year explicity mentions that Microsoft Research tested their algorithms "on the MS-Celeb-1M low-shot learning benchmark task."

    -

    We suggest that if Microsoft Research wants biometric data for surveillance research and development, they should start with own researcher's biometric data instead of scraping the Internet for journalists, artists, writers, and academics.

    +

    What the decision to block the sale announces is not so much that Microsoft had upgraded their ethics, but that Microsoft publicly acknowledged it can't sell a data-driven product without data. In other words, Microsoft can't sell face recognition for faces they can't train on.

    +

    Until now, that data has been freely harvested from the Internet and packaged in training sets like MS Celeb, which are overwhelmingly white and male. Without balanced data, facial recognition contains blind spots. And without datasets like MS Celeb, the powerful yet inaccurate facial recognition services like Microsoft's Azure Cognitive Service also would not be able to see at all.

    +

    Microsoft didn't only create MS Celeb for other researchers to use, they also used it internally. In a publicly available 2017 Microsoft Research project called "(One-shot Face Recognition by Promoting Underrepresented Classes)", Microsoft leveraged the MS Celeb dataset to analyze their algorithms and advertise the results. Interestingly, Microsoft's corporate version of the paper does not mention they used the MS Celeb datset, but the open-access version published on arxiv.org explicitly mentions that Microsoft Research tested their algorithms "on the MS-Celeb-1M low-shot learning benchmark task."

    +

    We suggest that if Microsoft Research wants to make biometric data publicly available for surveillance research and development, they should start with releasing their researchers' own biometric data instead of scraping the Internet for journalists, artists, writers, actors, athletes, musicians, and academics.

    Who used Microsoft Celeb?

    @@ -313,10 +228,8 @@

    Supplementary Information

    -

    References

    • 1 Brad Smith cite -
    • 2 aMS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition -
    • 3 aMicrosoft worked with Chinese military university on artificial intelligence -
    • 4 a"Exploring Disentangled Feature Representation Beyond Face Identification" +

    References

    • 1 aMS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition +
    • 2 aMurgia, Madhumita. Microsoft worked with Chinese military university on artificial intelligence. Financial Times. April 10, 2019.
    -- cgit v1.2.3-70-g09d2