Christo Wilson

After-hours Command Line Basics

Mon, 01 Jan 0001 00:00:00 +0000

General Information


Instructors	Martin Petrauskas and Christo Wilson
Classroom	Behrakis 010
Time	Mondays, 6-7pm

Why Command Lines?

The command line was one of the first interfaces through which people could dynamically interact with computers. In the 70’s and early 80’s, it was essentially the only way to interact with mainframe and proto-desktop computers. Even today, all operating systems support command line interfaces of some sort.

Given how sleek modern operating systems are (i.e. with mice, touch screens, and 3D-accelerated application windows), this begs the question: why do we still need command lines? The answer is that command lines are powerful. For many tasks, they are faster and less error prone than alternative interfaces that rely on windows, mice, clicking, tapping, etc. Further, command lines are ideal for automation. It is trivially easy to automate and systematize repetitive tasks using a command line; tasks that would otherwise be monotonous and time consuming. Lastly, command lines are ideal for accessing and controlling computers remotely. In an age of cloud computing, the need to remotely administer resources is greater than ever. In summary: command lines are not a useless relic from computing history; they are a vital and powerful tool of the present.

Algorithm Audits

Mon, 01 Jan 0001 00:00:00 +0000

Sociotechnical systems driven by big data and (sometimes) machine learning are increasingly being deployed in the real world, in consequential scenarios like hiring, banking, access to governmental resources, and policing. These systems, whether intentionally or inadvertently, may exhibit problems like unfairness and bias that may negatively impact real people. One crucial mechanism towards achieving transparency and accountability around such systems is the algorithm audit: an independent evaluation of a system to ascertain whether (1) the purported functionality of the system matches it actual implementation, and (2) whether the system contains latent issues that may results in unfairness or bias.

Funding

Mon, 01 Jan 0001 00:00:00 +0000

I have been fortunate to receive generous funding from several sources throughout my career.

Northwestern University/Underwriters Laboratories. Dark Patterns in AI-enabled Consumer Experiences, June 1 2023 – December 31 2025. Co-Primary Investigator, joint with David Choffnes. $275000.
National Science Foundation. Supplement: Mid-scale RI-1 (M1:IP): Observatory for Online Human and Platform Behavior, January 1 2023 – September 30 2026. Co-Primary Investigator, joint with David Lazer and David Choffnes. $167000 (NEU), $500000 (Total).
National Institute of Health. Older Adult Suicidality and Social Behavior (OASIS-B), January 1 2022 – December 31 2026. Co-Primary Investigator. $931000.
National Science Foundation. Mid-scale RI-1 (M1:IP): Observatory for Online Human and Platform Behavior, October 1 2021 – September 30 2026. Co-Primary Investigator, joint with David Lazer and David Choffnes. $15717700.
Pymetrics. Auditing Pymetrics Models for Gender and Racial Bias, March 26 2020 – July 31 2020. Co-Primary Investigator, joint with Alan Mislove. $104465.
Google. 2019 Android Security and Privacy REsearch project (ASPIRE), December 1 2019. Co-Primary Investigator, joint with David Choffnes. $75000.
Russell Sage Foundation. Assessing Algorithmic and Human Selective Exposure to Political Information, September 1 2019 – August 31 2020. Co-Primary Investigator, joint with Brendan Nyhan (Dartmouth) and Andrew Guess (Princeton). $172057.
National Science Foundation. CHS: Small: Auditing Critical Dependencies Between Online Media Platforms, August 15 2019 – July 31 2022. Primary Investigator. $499811.
Sloan Foundation. Sloan Fellowship, June 1 2019 – May 31 2021. Primary Investigator. $75000.
National Science Foundation. CNS Core: Large: Collaborative Research: Towards an Evolvable Public Key Infrastructure, June 1 2019 – May 31 2022. Co-Primary Investigator, joint with Dave Levin (UMD) and Alan Mislove and Bruce Maggs (Duke) and Bryan Parno (CMU) and Taejoong Chung (RPI). $400936 (NEU), $1200000 (Total).
Anti-Defamation League. Exposure to Hateful and Conspiratorial Content on YouTube, May 16 2019 – May 15 2020. Co-Primary Investigator, joint with Brendan Nyhan (Dartmouth) and Andrew Guess (Princeton) and Jason Reifler (Exeter). $50000.
Mozilla Foundation. Integrating Value Sensitive Design Training Throughout the CS Curriculum, April 22 2019 – July 12 2020. Primary Investigator, joint with Ronald Sandler. $148349.
National Science Foundation. Planning Grant: Engineering Research Center for Sharing economy - Humans, Automation, Resilience and Engineering: SHARE, September 1 2018 – July 31 2019. Co-Primary Investigator. $99423.
Democracy Fund. Misinformation on Social Media Platforms Around the 2018 Election Season, September 1 2018 – August 31 2019. Co-Primary Investigator, joint with David Lazer. $40000.
Russell Sage Foundation. Inequality in Online Labor Markets, July 1 2017 – June 30 2019. Primary Investigator, joint with Aniko Hannak and David Lazer. $113628.
Northeastern University. TIER 1: Uncovering Strategic Consumer Data Collection and Sharing in Online Markets by Tracing Information Flows, July 1 2017 – June 30 2018. Co-Primary Investigator, joint with Yakov Bart. $50000.
National Science Foundation. CAREER: Towards Methodologies and Tools for Conducting Algorithm Audits, CHS-1553088, July 1 2016 – June 30 2021. Primary Investigator. $504000.
National Science Foundation. TWC: Medium: Collaborative: Measuring and Improving the Management of Today's PKI, CNS-1563320, July 1 2016 – June 30 2020. Co-Primary Investigator, joint with Dave Choffnes and Alan Mislove and Dave Levin (UMD) and Tudor Dumitraş (UMD). $598000 (NEU), $1198000 (Total).
Knight Foundation. Public Access to Pricing Personalization, August 1 2015 – June 30 2016. Co-Primary Investigator, joint with David Lazer and Alan Mislove. $35000.
Data Transparency Lab. Revealing and Controlling Mobile Privacy Leaks, July 1 2015 – July 1 2016. Co-Primary Investigator, joint with David Choffnes and Alan Milsove. $55000.
National Science Foundation. CHS: Medium: Towards Transparency of Personalization on the Web, CHS-1408345, July 15 2014 – June 30 2018. Primary Investigator, joint with David Lazer and Alan Mislove. $743000.
Intelligent Automation, Inc.. A Trusted Framework for Embedded Systems, January 1 2014 – December 31 2015. Co-Primary Investigator, joint with Engin Kirda and Wil Robertson. $225000.
National Science Foundation. CSR: Small: Towards Confederated Web-Based Services, CNS-1319019, September 1 2013 – August 31 2016. Co-Primary Investigator, joint with Alan Mislove. $499000.
Verisign Labs. Quantifying WHOIS Usage and Defending Against Abuse, July 1 2013. Primary Investigator, joint with Engin Kirda. $20000.

News

Mon, 01 Jan 0001 00:00:00 +0000

June 2024: I am honored to report that I have been promoted to Full Professor! Thank you to all my students, collaborates, and colleagues who have helped me reach this milestone.
May 2024: Congrats to Desheng, Jeffrey, and Aziz: their paper examining the market for online search received an Honorable Mention Award at ICWSM 2024 (one of three total awards given at the conference)! Our group has received paper awards at ICWSM for two year running!
November 2023: We have two papers accepted to appear at ICWSM 2024: one focusing on different conceptualizations of Google’s power in the market for search engines, and one focused on offensive and defensive brand advertising on search engines. Camera ready copies will be posted soon. Congrats to all the authors! These papers represent the culmination of collaborations stretching across computer science, law, and business.
June 2023: Congrats to Jeffrey Gleason, whose ICWSM paper “Google the Gatekeeper” received a Best Paper award!
May 2023: Huge congrats to Dr. Ronald E. Robertson and all our co-authors on our new Nature paper. We examine how people engage with partisan and unreliable news, and find that Google Search is not creating filter bubbles: Google tends to show diverse news sources to all people, but partisans choose to follow links and visit websites that align with their political beliefs.
May 2023: The co-plaintiffs and our excellent lawyers on the Sandvig v. Barr lawsuit were honored to receive the Outstanding Applied or Public Research Award from the International Communication Association (ICA)! The award recognizes our efforts to protect Internet researchers from the chilling effect of prosecution from the Computer Fraud and Abuse Act (CFAA).
April 2023: I was honored to present the 59th Robert D. Klein Lecture at Northeastern, which is given each year by a member of the teaching faculty who has contributed with distinction to his or her field of study.
March 2023: Congrats to Jeffrey Gleason on his first first-author publication, accepted to ICWSM 2023! More details on this research and the camera ready will be available in May.
February 2023: Johanna Gunawan’s work on dark patterns has been cited by the OECD, in new regulations supporting the Colorado Privacy Act, and in testimony from the Center for Democracy & Technology before the US House.
November 2022: Big congrats to James Larisch and the rest of Team PKI for winning a Best Paper Honorable Mention Award at CCS 2022 for Hammurabi! Our system moves the PKI forward by cleanly separating TLS certificate parsing mechanisms from validation policy, allowing TLS clients to easily adopt and modify sophisticated validation policies. Hammurabi makes it easy to, for example, make Firefox behave like Chrome!
November 2021: I gave remarks about how algorithm auditing can increase transparency and accountability during a White House Office of Science and Technology Policy panel. The full discussion can be viewed here.
October 2021: It’s official: David Lazer, David Choffnes, and I have been awarded $15.7 million from the NSF to build a large-scale observatory of human and algorithmic behavior online. This is a massive, five year project, and the ultimate goal is to build a platform that provides unprecedented data about online life to a wide variety of researchers in a safe, ethical way.
September 2021: It’s been a long time coming: our first paper on deceptive user interface dark patterns is out in CSCW. This paper does a cross-modality comparison of dark patterns across mobile apps, mobile websites, and desktop websites, and finds problematic cases where services offer essential features in some modalities but not others. We’ve also got a new website specifically focused on our dark patterns research.
June 2021: The Supreme Court has ruled in the Van Buren v. US case that terms of service (ToS) violations are not CFAA violations. The ruling cites our case, Sandvig v. Barr, and our amicus brief. I am elated that SCOTUS has largely lifted the cloud of uncertainty surrounding the CFAA and ToS violations, and humbled that our own efforts played a teensy tiny part in the resolution of this case.
May 2021: I am excited to finally have a paper at SIGIR! Avijit’s new research examines the use of inferred demographic features an input to fair ranking algorithms, and finds, unfortunately, that errors in inference completely undermine the fairness guarantees of these systems. Our results highlight that there is no free lunch when it comes to building fair systems: high-quality ground-truth data is key.
February 2021: In association we the Anti Defamation League, and researchers from Dartmouth and Exeter, we’ve published our first report on hate speech and anti-semitism on YouTube. We don’t find strong evidence for recommendation-driven “rabbit holes” that lead ordinary people to extremist content, but we do observe a small and highly motivated community that watches a lot of hateful content on YouTube. Our results point to the need for stronger baseline standards of content moderation on YouTube.
February 2021: The lead story on MIT Tech Review is about our audit of pymetrics. The corresponding paper is available here. Great quotes from some some of my favorite law/policy scholars, Frank Pasquale and Pauline Kim.
December 2020: I’m excited to announce that we have a new paper accepted to FAccT (formerly FAT*) 2021. This paper presents the results of a collaborative algorithm audit where we critically examined the fair machine learning pipeline used by recruiting startup pymetrics. The paper is available here.
July 2020: My co-plaintiffs and I on Sandvig v. Barr have filed an amicus brief in the Van Buren v. US case that will be argued before the US Supreme Court. Like Sandvig, Van Buren concerns the limits of the Computer Fraud and Abuse Act (CFAA). The ACM have also filed an amicus brief that cites our research to motivate why the court should move to narrowly interpret the CFAA.
March 2020: I am elated to announce that the court has ruled in our favor in our lawsuit against the Department of Justice regarding the Computer Fraud and Abuse Act (CFAA). Here’s the full opinion, and press from the ACLU. TL;DR, the court found that terms of service violations are not CFAA violations, which is amazing!
March 2020: Congrats to Shan on his accepted ICWSM 2020 paper entitled “Modeling and Measuring Expressed (Dis)belief in (Mis)information”. There is a wealth of literature on the spread of misinfo on social media, but this paper takes a more nuanced dive, asking whether people actually believe this content. Turns out, things are complicated! The camera ready should be available in April.
August 2019: It is always a bittersweet day for an advisor when their PhD students defend. A huge congrats to Dr. Muhammad Ahmad Bashir for defending his thesis, entitled “On the Privacy Implications of Real Time Bidding”. Ahmad will be starting a post-doc this fall with Serge Egelman in Berkeley.
July 2019: Congrats to Ahmad in his accepted IMC 2019 paper entitled “A Longitudinal Analysis of the ads.txt Standard”. This is the first paper to look at the adoption and impact of the new ads.txt transparency protocol. Paper available here.
June 2019: I am excited and honored to be a 2019-2020 Fellow at the Berkman Klein Center for Internet & Society at Harvard University. I’m looking forward to spending my sabbatical working on cross-cutting research at the intersection of computer science and public policy.
June 2019: Shan and Ron’s paper, “Bias Misperceived: The Role of Partisanship and Misinformation in YouTube Comment Moderation”, is the winner of a well-deserved Outstanding Analysis award at ICWSM 2019!
April 2019: Khoury College has been selected as one of the phase 1 winners of the Mozilla Foundation’s Responsible Computer Science Challenge! This fall I’ll be working with Ronald Sandler and John Basl to develop new ethics teaching materials and weave them throughout our undergraduate classes.
March 2019: I am thrilled and honored to receive the 2019 Excellence in Research and Creative Activity Award from Northeastern!
February 2019: I am deeply honored and humbled to be named a 2019 Sloan Fellow. Thank you to all my collaborators and students who made this possible!
December 2018: Congrats to Ahmad for winning best student paper at the Future of Privacy Forum’s Annual Privacy Papers for Policymakers Awards! These papers are summarized and distributed directly to policymakers in Washington. We are humbled and honored by this distinction.
December 2018: Our IMC 2017 paper on the abysmal state of DNSSEC support by registrars was awarded one of the 2019 Applied Networking Research Prizes from the IRTF and the Internet Society. Congrats to the whole team!
November 2018: Congrats to Ahmad, Umar, and Maryam, on their accepted paper at NDSS 2019. This work presents the first large-scale study of the “interests” that ad networks infer about online users. Key takeaway: these interests are often wrong, and ads are being mis-targeted to uninterested people.
November 2018: Ron’s CSCW 2018 paper on partisan bias in Google Search results received an Honorable Mention award!
October 2018: Congrats to John and Shan on their new FAT* paper that critically examines the A/B experiments that websites routinely run on their users, without their knowledge.
August 2018: Two CSCW papers accepted this year! Congrats to Ron and Shan on their papers. I’m very proud to say that this represents my first accepted paper that is full of emoji, which is an important professional milestone 😉
July 2018: Two IMC papers accepted this year! Congrats to TJ and Team PKI on their new paper “Is the Web Ready for OCSP Must Staple?”, and to Ahmad on the conference version of his paper “How Tracking Companies Circumvented Ad Blockers Using WebSockets”.
July 2018: Fun video, in which I warn Molly Callahan from News@Northeastern that she will starve if she tries to live on Bitcoin for a day.
June 2018: Achievement: unlocked. I am now an Associate Professor! Thank you to all my students and collaborators over the last six years, without whom this would not have been possible. Thank you to my family, for their unconditional support. And of course, thanks to the boss.
May 2018: We have two new papers appearing at PETS 2018: Elleen and Jingjing have a paper examining leaks of audio, video, and images from Android apps, Ahmad has one on modelling the diffusion of tracking data in the ad ecosystem.
February 2018: Our CHI 2018 paper on gender discrimination on hiring websites has been selected for an Honorable Mention award!
December 2017: Congrats to Le, Ancsa, and Ruijun on their upcoming CHI paper, which examines gender discrimination on hiring websites. This is our first CHI paper ever!
December 2017: Usenix ;login: magazine has a slick article this month covering the highlights of our recent measurements of DNSSEC deployment. TL;DR DNSSEC deployment remain low, but even worse is that a large fraction of existing deployments are incorrect, and local nameservers are failing to validate DNSSEC records even after they explicitly ask for them. Registrars make the problem worse by not having consistent or secure (or on-by-default) mechanisms for managing DNSSEC records.
December 2017: TJ has a post up on the APNIC blog about our recent IMC paper on why DNSSEC adoption is so low, and potential ways to spur deployment.
September 2017: Congratulations to James Larisch and the rest of the CRLite team for winning the 2017 IEEE Cybersecurity Award for Innovation!
September 2017: I am thrilled to be helping to organize the inaugural Conference on Fairness, Accountability, and Transparency (FAT*). Paper submissions are due October 6, 2017!
August 2017: Update your links: my homepage has moved to a new home at https://cbw.sh/.
August 2017: Honored and excited to receive a distinguished paper award at Usenix Security 2017 for TJ’s DNSSEC ecosystem paper!
August 2017: Paper news: congrats to TJ on his IMC 2017 paper on the misbehavior of DNS registrars with respect to DNSSEC, and to Ron on his CSCW 2018 paper on design interventions to prevent the search engine manipulation effect.
June 2017: The San Francisco County Transportation Authority (SFCTA) just released their first report on ridesharing in San Francisco, in collaboration with us. They’ve put together some awesome visualizations of the Uber and Lyft data!
June 2017: I’m honored to be serving as the Director of the brand-new Bachelors in Cybersecurity degree program, starting in Fall 2017. I’m excited to help craft the new curriculum for our first students!
June 2017: Congrats to TJ and the rest of Team PKI on our Usenix Security 2017 paper, which examines systematic flaws in the way DNSSEC is being deployed and administered.
April 2017: My office is moving from West Village H to the new Interdisciplinary Science and Engineering Complex (ISEC), along with the rest of the faculty in the Security and Privacy Institute. I am thrilled be in such a gorgeous building!
February 2017: The PKI Research Group strikes again: congrats to Northeastern undergrad James Larisch on his accepted paper to IEEE Security and Privacy 2017! Our new system compactly represents all certificate revocations (<1 byte per) so that they can be efficiently pushed to all browsers.
October 2016: Congrats to Zhenhua, Toby, and Beri on their NDSS 2017 papers! One paper examines inclusion of vulnerable JavaScript libraries into websites, while the other evaluates a system for detecting fake cellular base stations in the wild. We’ve been incredibly fortunate to get papers into the last three consecutive top-tier security conferences!
September 2016: Congrats to Dr. Ancsa Hannak on her recently accepted CSCW 2017 paper that examines racial and gender biases on gig economy websites!
August 2016: It’s a big month for papers. Congrats to Ahmad, Sajjad, Chris, Jingjing, TJ, and Yabing on their IMC papers! All told, Northeastern got 7 paper into IMC this year. Also, congrats to Frank and TJ on their CCS 2016 paper!
July 2016: The CFP for the Data and Algorithmic Transparency Workshop is now available. DAT is being colocated with FatML and the Data Transparency Lab Conference in November at Columbia. This whole event is going to be awesome!
July 2016: Alan Mislove, Christian Sandvig, Karrie Karahalios, and I are plaintiffs in a lawsuit being brought against the federal government by the ACLU, seeking to overturn specific provisions of the CFAA. Christian has penned a nice explanation of the suit.
June 2016: I am now the proud recipient of an NSF CAREER award, which will support our continued work on algorithmic auditing.
June 2016: Our work on Amazon Marketplace is getting a lot of press coverage lately.
May 2016: Congrats to Ahmad on his Usenix Security 2016 paper! The paper presents a methodology for detecting cookie matching between ad networks, even when the process is obfuscated.
February 2016: We have received a contract to help the European Commission identify online price discrimination and other market distortions in their Digital Single Market initiative.
December 2015: Congrats to Zhenhua on his NSDI 2016 paper (Baidu TrafficGuard), and Le and Gary on their WWW 2016 papers (dynamic pricing on Amazon, and personalized online maps, respectively)! An auspicious start to 2016!
October 2015: Huge press coverage (more and more!) for our study of Uber’s surge pricing algorithm.
June 2015: Exciting news about grants. We are the proud recipients of one of the inaugural Data Transparency Lab grants! We also received an award from the Knight Foundation Prototype Fund to build a public version of our tools for detecting online price discrimination.
February 2015: Our online price discrimination study was cited in the White House Economic Advisers’ Report on Big Data.
February 2015: Our work on uncovering personalization algorithms is part of this weeks cover story in New Scientist!
October 2014: The CBS Evening News ran a piece on our price discrimination work, including an interview with yours truly. The video can be found here.

Press

Mon, 01 Jan 0001 00:00:00 +0000

I try to conduct research that has broad and immediate impact. One measure of this is looking at press coverage. I feel that it is very important to inform and educate the public about research results, especially concerning issues like security, privacy, and algorithmic transparency.

Publications

Mon, 01 Jan 0001 00:00:00 +0000

Service

Mon, 01 Jan 0001 00:00:00 +0000

I frequently serve on conference committees, NSF panels, and other miscellaneous organizational roles in the academic community, as well as on committees within Northeastern.

Service to the Institution

College Service

Chair, Undergraduate Committee, 2023–present
Affiliate Member, Institute for Experiential AI at Northeastern, 2021–present
Affiliate Member, Center for Law, Innovation and Creativity, 2020–present
Member, Tenure Committee, 2018–present
Member, Institute Advisory Board, Cybersecurity and Privacy Institute at Northeastern, 2018–2025
Representative, Undergraduate Committee, 2017–2023
Representative, Khoury Postdoctoral Scholar Committee, 2023
Interdisciplinary Search Chair, Hiring Committee, 2021–2022
Representative, Academic Integrity Committee, 2017–2020
Representative, Teaching Award Committee, 2017–2020
Faculty Advisor, Northeastern University Planeswalkers, 2017–2019
Representative, Program Design Principals Reform Committee, 2016–2017
College Evangelist, 2015–2016
Faculty Advisor, Northeastern chapter of the ACM Club, 2014–2022
Representative, Hiring Committee, 2014–2015
Representative, Faculty Merit Committee, 2014
Representative, PhD Committee, 2012–2014

University Service

Students

Mon, 01 Jan 0001 00:00:00 +0000

Current Students

I have the honor of working with many talented students at Northeastern. I am currently advising several PhD and undergraduate students:

PhD Students

Desheng Hu: Using natural language processing techniques to measure changes in language usage over time, as well as the linguistic biases that are embedded in large-scale systems.
Muhammad Abu Bakar Aziz: Algorithm auditing and online privacy.
Sarah Gillespie: Privacy and security of connected cars.
Athicha Srivirote: Privacy concerns with in-browser tracking and advertising technologies.

Former Students

In the past, I’ve worked with many talented PhD, masters, and undergraduates students.