Materials and Methods
“Quantitative analysis of culture using millions of digitized books”, Michel et al.
Contents |, OvervieW of Google BOOKS DIGILIZALION ciseiccvsvesees canweneeusveners caus eueeunveners cans eueeunyeqers cans eeeernyeners canweeees 3 1.1. Metadata o.oo... cece cccccce cece cece cee aeeeee ee ee ec aeaeeeeeeeee ce aaeaeeeeeeeeececcaeaeeeeeeesecsccueaeeseeeeseeseneees 3 Fae Be] t72-) (0) s 4 1.3. Structure Extraction ...........cccecccceccceceeeeeeeeeeeeeeeeeseccaeaeeeeeeeseseccaeaeeeeeeeseceecueaeeeeeeeseesenieees 4 Il. Construction of Historical N-grams Corpora ........cccccccccccccccececeseseseeeseeeseeeseceseseseneseseseseseseneteneeenenes 5 I1.1. Additional filtering Of DOOKS ..... ccc cccccccececeeeeeeeeeeeeeeeeeseeeeeeeseeeeeeeeeeeneneeesenenenenenenes 5 Il.1A. Accuracy of Date-of-Publication Metadata 2.0... ccccccccccccececeeeeeeeseseeeeeeeseeeeeseeenenes 5 Pf = @ LO) ne (0 r- || 6 I1.1C. Accuracy of language Metadata... cccccccccccccececeseseseseeeseeeeeseeeseseeeeeeesesesesesenenes 6 ILTD: V6ar REStrCUOR semcessmarce: cammmemnenmancts tamenmemneninnent UaMenNRNanineN: SmmEnERMNNOREN: SuEmnRMUNETRER: emmeRR 7 I|.2. Metadata based subdivision of the Google Books Collection.............cccccccccceseseeeeenes 7 I1.2ZA. Determination Of IANQUAGE ....... cc ccccccccccccececeeececeeeeeeeeeeeeeeeeeeeseeeeeseeeseseeeeeeeeenetenenenenes 7 I1.2B. Determination of book subject ASSIQGNMENtS.......... cc cccccccccccececeseeeseseeeseeeseseeeeesenenenes 7 I1.2C. Determination of book CouNtry-Of-PUDIICATION ..... cc ccccccceeecesececeeeeeeeeeseseeeeenenenes 7 I1.3. Construction of historical N-QraMS COPPOLA ....... cc ccccccccccceccccseceeeseseseseseseeeeeeeeeseeesesenenenes 8 II.3A. Creation of a digital sequence of 1-grams and extraction of n-gram counts............. 8 I1.3B. Generation of historical N-QraMS COPPOLA .......cccccccccccceccceseseseseseseseeeseseseeesesesesenenenes 10 Ill. Culturomic AnalySe@ss ...........c.ccccccceeecccce eee eeaeeeeeeeeeeeaeaeaeaeaeaeaeaeaeeeeeaeaeaeeeaeaeeeseeeeeeeeeeeeeaeeeaeseeeeeeeeseeeeesneeaees 12 IlL.O; GRAS] REMARKS xcesmacccs wsemsummmnens wmewamnmmeens impaeRNENeR IaOIMAERUARNER SaNISMNteREMRNNERY tauNNenemRNER saree 12 | Oa ©) pk Occ) 1 ole) kc; 12 I11.0.2 On the number Of BOOKS PUDLISNE)M «0.2.0... ccc cece cececesesececeeeneceeeeeseeeseseseeeseeesenenetesenenenees 13 II1.1. Generation of timeline Plots oo... cc cccccceceeeeeeeceeeeeseeeeeseseeeeeeeeeeeeeeeeeseseneseseeeeesetesenenenees 13 WN. 1A. Single QUETY ....... ccc ccc cece cecene cece cette caeae cece eects aaeaeeeeeeesecaaeaeeeeeeesecceaeeeeeeeeesecensaeeeeeereetenes 13 I11.1B. Multiple Query/Cohort Timelines ............c.cccccceececeecce cece cece eeeaeceeeeeeeseceeeaeceeeeeeeseeseneeeeeeseeeeee 14 III.2. Note on collection of historical and cultural data ..............cececeeeccceceeeeeeeeeeeceeeeeeeeeeeeseeeeeereneeees 14 IU:3: GQHUUGS ccc nmcommeresenne enecmeNeRs SIMONI: STRING SRNR SKETRTRG eaeURES sane 15 ILL.4. LE XIGOR ANALYSIS: ccxccssvesors cnwenenmmmeners cuseueemenets dane reeeeNReNeNs CanETHOMENENENS CaNSHOREANENENS canSTHOMENNENENS cane 15 1
HOUSE_OVERSIGHT_017009