{"data":{"id":"10.1184/r1/7571876.v1","type":"dois","attributes":{"doi":"10.1184/r1/7571876.v1","prefix":"10.1184","suffix":"r1/7571876.v1","identifiers":[],"alternateIdentifiers":[],"creators":[{"name":"Weinberg, Zachary","nameType":"Personal","givenName":"Zachary","familyName":"Weinberg","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Toward Automated Worldwide Monitoring of Network-level Censorship"}],"publisher":"Carnegie Mellon University","container":{},"publicationYear":2019,"subjects":[{"subject":"90699 Electrical and Electronic Engineering not elsewhere classified","subjectScheme":"FOR"},{"subject":"FOS: Electrical engineering, electronic engineering, information engineering","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Electrical engineering, electronic engineering, information engineering","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2019-01-18","dateType":"Created"},{"date":"2019-01-18","dateType":"Updated"},{"date":"2019","dateType":"Issued"}],"language":null,"types":{"ris":"DATA","bibtex":"misc","citeproc":"dataset","schemaOrg":"Dataset","resourceType":"Dataset","resourceTypeGeneral":"Dataset"},"relatedIdentifiers":[{"relationType":"IsIdenticalTo","relatedIdentifier":"10.1184/r1/7571876","relatedIdentifierType":"DOI"}],"relatedItems":[],"sizes":["173221893 Bytes"],"formats":[],"version":null,"rightsList":[{"rights":"In Copyright","rightsUri":"http://rightsstatements.org/vocab/InC/1.0/"}],"descriptions":[{"description":"Although Internet censorship is a well-studied topic, to date most published studies have focused\u003cbr\u003eon a single aspect of the phenomenon, using methods and sources specific to each researcher.\u003cbr\u003eResults are di cult to compare, and global, historical perspectives are rare. Because each group\u003cbr\u003emaintains their own software, erroneous methods may continue to be used long after the error has\u003cbr\u003ebeen discovered. Because censors continually update their equipment and blacklists, it may be\u003cbr\u003eimpossible to reproduce historical results even with the same vantage points and testing software.\u003cbr\u003eBecause “probe lists” of potentially censored material are labor-intensive to compile, requiring an\u003cbr\u003eunderstanding of the politics and culture of each country studied, researchers discover only the most\u003cbr\u003eobvious and long-lasting cases of censorship.\u003cbr\u003eIn this dissertation I will show that it is possible to make progress toward addressing all of\u003cbr\u003ethese problems at once. I will present a proof-of concept monitoring system designed to operate\u003cbr\u003econtinuously, in as many di erent countries as possible, using the best known techniques for\u003cbr\u003edetection and analysis. I will also demonstrate improved techniques for verifying the geographic\u003cbr\u003elocation of a monitoring vantage point; for distinguishing innocuous network problems from\u003cbr\u003ecensorship and other malicious network interference; and for discovering new web pages that are\u003cbr\u003eclosely related to known-censored pages. These techniques improve the accuracy of a continuous\u003cbr\u003emonitoring system and reduce the manual labor required to operate it.\u003cbr\u003eThis research has, in addition, already led to new discoveries. For example, I have confirmed\u003cbr\u003ereports that a commonly-used heuristic is too sensitive and will mischaracterize a wide variety of\u003cbr\u003eunrelated problems as censorship. I have been able to identify a few cases of political censorship\u003cbr\u003ewithin a much longer list of cases of moralizing censorship. I have expanded small seed groups of\u003cbr\u003epolitically sensitive documents into larger groups of documents to test for censorship. Finally, I\u003cbr\u003ecan also detect other forms of network interference with a totalitarian motive, such as injection of\u003cbr\u003esurveillance scripts.\u003cbr\u003eIn summary, this work demonstrates that mostly-automated measurements of Internet censorship\u003cbr\u003eon a worldwide scale are feasible, and that the elusive global and historical perspective is within\u003cbr\u003ereach.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjEvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC4xMTg0L1IxLzc1NzE4NzYuVjE8L2lkZW50aWZpZXI+CiAgPGNyZWF0b3JzPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZT5aYWNoYXJ5IFdlaW5iZXJnPC9jcmVhdG9yTmFtZT4KICAgIDwvY3JlYXRvcj4KICA8L2NyZWF0b3JzPgogIDx0aXRsZXM+CiAgICA8dGl0bGU+VG93YXJkIEF1dG9tYXRlZCBXb3JsZHdpZGUgTW9uaXRvcmluZyBvZiBOZXR3b3JrLWxldmVsIENlbnNvcnNoaXA8L3RpdGxlPgogIDwvdGl0bGVzPgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+QWx0aG91Z2ggSW50ZXJuZXQgY2Vuc29yc2hpcCBpcyBhIHdlbGwtc3R1ZGllZCB0b3BpYywgdG8gZGF0ZSBtb3N0IHB1Ymxpc2hlZCBzdHVkaWVzIGhhdmUgZm9jdXNlZCZsdDticiZndDtvbiBhIHNpbmdsZSBhc3BlY3Qgb2YgdGhlIHBoZW5vbWVub24sIHVzaW5nIG1ldGhvZHMgYW5kIHNvdXJjZXMgc3BlY2lmaWMgdG8gZWFjaCByZXNlYXJjaGVyLiZsdDticiZndDtSZXN1bHRzIGFyZSBkaSBjdWx0IHRvIGNvbXBhcmUsIGFuZCBnbG9iYWwsIGhpc3RvcmljYWwgcGVyc3BlY3RpdmVzIGFyZSByYXJlLiBCZWNhdXNlIGVhY2ggZ3JvdXAmbHQ7YnImZ3Q7bWFpbnRhaW5zIHRoZWlyIG93biBzb2Z0d2FyZSwgZXJyb25lb3VzIG1ldGhvZHMgbWF5IGNvbnRpbnVlIHRvIGJlIHVzZWQgbG9uZyBhZnRlciB0aGUgZXJyb3IgaGFzJmx0O2JyJmd0O2JlZW4gZGlzY292ZXJlZC4gQmVjYXVzZSBjZW5zb3JzIGNvbnRpbnVhbGx5IHVwZGF0ZSB0aGVpciBlcXVpcG1lbnQgYW5kIGJsYWNrbGlzdHMsIGl0IG1heSBiZSZsdDticiZndDtpbXBvc3NpYmxlIHRvIHJlcHJvZHVjZSBoaXN0b3JpY2FsIHJlc3VsdHMgZXZlbiB3aXRoIHRoZSBzYW1lIHZhbnRhZ2UgcG9pbnRzIGFuZCB0ZXN0aW5nIHNvZnR3YXJlLiZsdDticiZndDtCZWNhdXNlIOKAnHByb2JlIGxpc3Rz4oCdIG9mIHBvdGVudGlhbGx5IGNlbnNvcmVkIG1hdGVyaWFsIGFyZSBsYWJvci1pbnRlbnNpdmUgdG8gY29tcGlsZSwgcmVxdWlyaW5nIGFuJmx0O2JyJmd0O3VuZGVyc3RhbmRpbmcgb2YgdGhlIHBvbGl0aWNzIGFuZCBjdWx0dXJlIG9mIGVhY2ggY291bnRyeSBzdHVkaWVkLCByZXNlYXJjaGVycyBkaXNjb3ZlciBvbmx5IHRoZSBtb3N0Jmx0O2JyJmd0O29idmlvdXMgYW5kIGxvbmctbGFzdGluZyBjYXNlcyBvZiBjZW5zb3JzaGlwLiZsdDticiZndDtJbiB0aGlzIGRpc3NlcnRhdGlvbiBJIHdpbGwgc2hvdyB0aGF0IGl0IGlzIHBvc3NpYmxlIHRvIG1ha2UgcHJvZ3Jlc3MgdG93YXJkIGFkZHJlc3NpbmcgYWxsIG9mJmx0O2JyJmd0O3RoZXNlIHByb2JsZW1zIGF0IG9uY2UuIEkgd2lsbCBwcmVzZW50IGEgcHJvb2Ytb2YgY29uY2VwdCBtb25pdG9yaW5nIHN5c3RlbSBkZXNpZ25lZCB0byBvcGVyYXRlJmx0O2JyJmd0O2NvbnRpbnVvdXNseSwgaW4gYXMgbWFueSBkaSBlcmVudCBjb3VudHJpZXMgYXMgcG9zc2libGUsIHVzaW5nIHRoZSBiZXN0IGtub3duIHRlY2huaXF1ZXMgZm9yJmx0O2JyJmd0O2RldGVjdGlvbiBhbmQgYW5hbHlzaXMuIEkgd2lsbCBhbHNvIGRlbW9uc3RyYXRlIGltcHJvdmVkIHRlY2huaXF1ZXMgZm9yIHZlcmlmeWluZyB0aGUgZ2VvZ3JhcGhpYyZsdDticiZndDtsb2NhdGlvbiBvZiBhIG1vbml0b3JpbmcgdmFudGFnZSBwb2ludDsgZm9yIGRpc3Rpbmd1aXNoaW5nIGlubm9jdW91cyBuZXR3b3JrIHByb2JsZW1zIGZyb20mbHQ7YnImZ3Q7Y2Vuc29yc2hpcCBhbmQgb3RoZXIgbWFsaWNpb3VzIG5ldHdvcmsgaW50ZXJmZXJlbmNlOyBhbmQgZm9yIGRpc2NvdmVyaW5nIG5ldyB3ZWIgcGFnZXMgdGhhdCBhcmUmbHQ7YnImZ3Q7Y2xvc2VseSByZWxhdGVkIHRvIGtub3duLWNlbnNvcmVkIHBhZ2VzLiBUaGVzZSB0ZWNobmlxdWVzIGltcHJvdmUgdGhlIGFjY3VyYWN5IG9mIGEgY29udGludW91cyZsdDticiZndDttb25pdG9yaW5nIHN5c3RlbSBhbmQgcmVkdWNlIHRoZSBtYW51YWwgbGFib3IgcmVxdWlyZWQgdG8gb3BlcmF0ZSBpdC4mbHQ7YnImZ3Q7VGhpcyByZXNlYXJjaCBoYXMsIGluIGFkZGl0aW9uLCBhbHJlYWR5IGxlZCB0byBuZXcgZGlzY292ZXJpZXMuIEZvciBleGFtcGxlLCBJIGhhdmUgY29uZmlybWVkJmx0O2JyJmd0O3JlcG9ydHMgdGhhdCBhIGNvbW1vbmx5LXVzZWQgaGV1cmlzdGljIGlzIHRvbyBzZW5zaXRpdmUgYW5kIHdpbGwgbWlzY2hhcmFjdGVyaXplIGEgd2lkZSB2YXJpZXR5IG9mJmx0O2JyJmd0O3VucmVsYXRlZCBwcm9ibGVtcyBhcyBjZW5zb3JzaGlwLiBJIGhhdmUgYmVlbiBhYmxlIHRvIGlkZW50aWZ5IGEgZmV3IGNhc2VzIG9mIHBvbGl0aWNhbCBjZW5zb3JzaGlwJmx0O2JyJmd0O3dpdGhpbiBhIG11Y2ggbG9uZ2VyIGxpc3Qgb2YgY2FzZXMgb2YgbW9yYWxpemluZyBjZW5zb3JzaGlwLiBJIGhhdmUgZXhwYW5kZWQgc21hbGwgc2VlZCBncm91cHMgb2YmbHQ7YnImZ3Q7cG9saXRpY2FsbHkgc2Vuc2l0aXZlIGRvY3VtZW50cyBpbnRvIGxhcmdlciBncm91cHMgb2YgZG9jdW1lbnRzIHRvIHRlc3QgZm9yIGNlbnNvcnNoaXAuIEZpbmFsbHksIEkmbHQ7YnImZ3Q7Y2FuIGFsc28gZGV0ZWN0IG90aGVyIGZvcm1zIG9mIG5ldHdvcmsgaW50ZXJmZXJlbmNlIHdpdGggYSB0b3RhbGl0YXJpYW4gbW90aXZlLCBzdWNoIGFzIGluamVjdGlvbiBvZiZsdDticiZndDtzdXJ2ZWlsbGFuY2Ugc2NyaXB0cy4mbHQ7YnImZ3Q7SW4gc3VtbWFyeSwgdGhpcyB3b3JrIGRlbW9uc3RyYXRlcyB0aGF0IG1vc3RseS1hdXRvbWF0ZWQgbWVhc3VyZW1lbnRzIG9mIEludGVybmV0IGNlbnNvcnNoaXAmbHQ7YnImZ3Q7b24gYSB3b3JsZHdpZGUgc2NhbGUgYXJlIGZlYXNpYmxlLCBhbmQgdGhhdCB0aGUgZWx1c2l2ZSBnbG9iYWwgYW5kIGhpc3RvcmljYWwgcGVyc3BlY3RpdmUgaXMgd2l0aGluJmx0O2JyJmd0O3JlYWNoLjwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CiAgPHN1YmplY3RzPgogICAgPHN1YmplY3Qgc2NoZW1lVVJJPSJodHRwOi8vd3d3LmFicy5nb3YuYXUvYXVzc3RhdHMvYWJzQC5uc2YvMC82QkI0MjdBQjk2OTZDMjI1Q0EyNTc0MTgwMDA0NDYzRSIgc3ViamVjdFNjaGVtZT0iRk9SIj45MDY5OSBFbGVjdHJpY2FsIGFuZCBFbGVjdHJvbmljIEVuZ2luZWVyaW5nIG5vdCBlbHNld2hlcmUgY2xhc3NpZmllZDwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxwdWJsaXNoZXI+Q2FybmVnaWUgTWVsbG9uIFVuaXZlcnNpdHk8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMTk8L3B1YmxpY2F0aW9uWWVhcj4KICA8ZGF0ZXM+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQ3JlYXRlZCI+MjAxOS0wMS0xODwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIj4yMDE5LTAxLTE4PC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJEYXRhc2V0Ij5EYXRhc2V0PC9yZXNvdXJjZVR5cGU+CiAgPHNpemVzPgogICAgPHNpemU+MTczMjIxODkzIEJ5dGVzPC9zaXplPgogIDwvc2l6ZXM+CiAgPHJlbGF0ZWRJZGVudGlmaWVycz4KICAgIDxyZWxhdGVkSWRlbnRpZmllciByZWxhdGVkSWRlbnRpZmllclR5cGU9IkRPSSIgcmVsYXRpb25UeXBlPSJJc0lkZW50aWNhbFRvIj4xMC4xMTg0L1IxLzc1NzE4NzY8L3JlbGF0ZWRJZGVudGlmaWVyPgogIDwvcmVsYXRlZElkZW50aWZpZXJzPgogIDxyaWdodHNMaXN0PgogICAgPHJpZ2h0cyByaWdodHNVUkk9Imh0dHA6Ly9yaWdodHNzdGF0ZW1lbnRzLm9yZy92b2NhYi9JbkMvMS4wLyI+SW4gQ29weXJpZ2h0PC9yaWdodHM+CiAgPC9yaWdodHNMaXN0Pgo8L3Jlc291cmNlPg==","url":"https://kilthub.cmu.edu/articles/Toward_Automated_Worldwide_Monitoring_of_Network-level_Censorship/7571876/1","contentUrl":null,"metadataVersion":1,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":4,"viewsOverTime":[{"yearMonth":"2026-09","total":4}],"downloadCount":0,"downloadsOverTime":[{"yearMonth":"2026-09","total":0}],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2019-01-18T21:52:23.000Z","registered":"2019-01-18T21:52:24.000Z","published":"2019","updated":"2020-08-27T21:07:59.000Z"},"relationships":{"client":{"data":{"id":"cmu.kilthub","type":"clients"}},"provider":{"data":{"id":"cmu","type":"providers"}},"media":{"data":{"id":"10.1184/r1/7571876.v1","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}