Skip to content
This repository has been archived by the owner on Jan 28, 2025. It is now read-only.

Sphinx preview #14

Open
wants to merge 236 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
236 commits
Select commit Hold shift + click to select a range
eef3478
added a couple of chapters.
jsm296 Mar 12, 2019
8bb0314
Create suggested_chapter_outline.md
IanMulvany Mar 13, 2019
c00e08c
Bundesbank chapter draft.
jsm296 Mar 15, 2019
f4a47fb
Merge branch 'master' of github.com:rich-context-competition/rich-con…
jsm296 Mar 15, 2019
a524d78
inital chapter added
IanMulvany Mar 21, 2019
7df1ddd
bundesbank files
IanMulvany Mar 22, 2019
70bc451
paderborn
IanMulvany Mar 22, 2019
4eceeac
allen ai
IanMulvany Mar 22, 2019
c3ebd55
updating chapter status
IanMulvany Mar 22, 2019
3d63713
updating chapter status
IanMulvany Mar 22, 2019
9549f36
Initial latex to markdown conversion
philipskokoh Mar 26, 2019
678a527
cleanup bibtex
philipskokoh Mar 26, 2019
68207b5
adding in dois to keyword and luxid mapping
IanMulvany Mar 29, 2019
2e8f13f
initial commit
ottowg Apr 1, 2019
8707084
added latex files to gitignore incl. pdf
ottowg Apr 1, 2019
096ca88
typo:
ottowg Apr 1, 2019
bc5c007
type
ottowg Apr 1, 2019
558fdbb
markdown github flavour
ottowg Apr 1, 2019
c13cf75
add github flavour
ottowg Apr 1, 2019
885e142
moved tex to base
ottowg Apr 1, 2019
aeba43b
added latex build files to gitignore
ottowg Apr 1, 2019
5d91863
Merge pull request #2 from ottowg/gesis
IanMulvany Apr 8, 2019
b30eb4a
Merge pull request #1 from philipskokoh/master
IanMulvany Apr 8, 2019
930714e
rcc-06 initial markdown
tong-zeng Apr 11, 2019
cbef01b
Reorganizing for book editing.
jonathanmorgan Apr 29, 2019
539ae2b
removing spaces and apostrophes from file names.
jonathanmorgan Apr 29, 2019
7b40e33
Merge pull request #1 from rich-context-competition/master
philipskokoh May 7, 2019
6a9af5a
Merge pull request #3 from sciosci/master
IanMulvany May 9, 2019
e48cddc
folder renaming
IanMulvany May 9, 2019
9ff54e8
updates on tables and references
philipskokoh May 14, 2019
3c5a8ff
Removed introduction
HaritzPuerto May 14, 2019
dcf589d
Removed dataset explanation
HaritzPuerto May 14, 2019
09fcb0b
Related words -> Literature review
HaritzPuerto May 14, 2019
1fd16c1
Added the new structure of the chapter
HaritzPuerto May 14, 2019
351d7de
fix references, tables, and internal links
philipskokoh May 14, 2019
283c463
fix reference links
philipskokoh May 14, 2019
9ca3962
fix equation and references in section 3 and 4
philipskokoh May 14, 2019
8acc51d
What did you do section introduction done
HaritzPuerto May 22, 2019
c1311ba
Removed conclusions
HaritzPuerto May 22, 2019
d9a8f25
Lessons learned section almost done
HaritzPuerto May 22, 2019
3200147
What worked and what didn’t section title added
HaritzPuerto May 22, 2019
6ac7330
started What worked and what didn’t
HaritzPuerto May 23, 2019
4761b19
Restructuring and minor edits
May 24, 2019
379cd7c
Update repo link
May 24, 2019
08d09e1
Research fields in What worked and what didn’t
HaritzPuerto May 27, 2019
82d1f65
test images
HongGiwon May 30, 2019
a968b1d
test images
HongGiwon May 30, 2019
3988ec2
Update test_conversion.md
HongGiwon May 30, 2019
02a6e77
test images
HongGiwon May 30, 2019
524828a
research method
minhson-kaist May 31, 2019
9ce5cee
research method - lesson learned
minhson-kaist May 31, 2019
6cf4ce1
Improved what didnt work and lessons learned
HaritzPuerto May 31, 2019
199caf3
Updated what worked with entity typing
HaritzPuerto May 31, 2019
f513ba1
whatworked
HongGiwon Jun 3, 2019
29d3136
Whatdif
HongGiwon Jun 3, 2019
6bafa94
nontech_corr
HongGiwon Jun 4, 2019
c8f9ed2
nontech_author
HongGiwon Jun 4, 2019
c06161d
changes
HongGiwon Jun 5, 2019
97e8fc0
nontech_researchmethod
HongGiwon Jun 5, 2019
ba6d0c9
Update test_conversion.md
HongGiwon Jun 5, 2019
1d974c0
Update test_conversion.md
HongGiwon Jun 5, 2019
87c7950
Update test_conversion.md
HongGiwon Jun 5, 2019
89b3036
renaming 09 chapter to make it shorter
IanMulvany Jun 5, 2019
3d9da0d
renaming 09 chapter to make filename shorter
IanMulvany Jun 5, 2019
4e869f6
copy of chapter 10 to make merging easier
IanMulvany Jun 5, 2019
481bd17
directory for combining chapters
IanMulvany Jun 5, 2019
ab037e4
Merge pull request #1 from HongGiwon/brgiwon
HaritzPuerto Jun 6, 2019
1b2044f
update first revision
philipskokoh Jun 10, 2019
f5033f2
add what worked
minhson-kaist Jun 13, 2019
7c53cf1
minor changes research methods what worked
HaritzPuerto Jun 13, 2019
3034e2a
add NER explanation
minhson-kaist Jun 13, 2019
3251877
add NER explanation
minhson-kaist Jun 13, 2019
7dae5b7
add NER explanation
minhson-kaist Jun 13, 2019
0298738
minor changes what worked-NER
HaritzPuerto Jun 13, 2019
164e3fb
Merge pull request #2 from HaritzPuerto/son
HaritzPuerto Jun 13, 2019
d1c333f
Fixed typos
HaritzPuerto Jun 14, 2019
0a1705c
Techinal documentation
HaritzPuerto Jun 14, 2019
1fd53e3
Minor change related works
HaritzPuerto Jun 14, 2019
903168d
Fix columns
HaritzPuerto Jun 14, 2019
65457d5
fix images
HaritzPuerto Jun 14, 2019
8cfb7e1
Fixed last image, added captions and fixed ref to img
HaritzPuerto Jun 15, 2019
c5541e7
Added link to question generation module
HaritzPuerto Jun 15, 2019
5121e19
Fix typos and columns
HaritzPuerto Jun 15, 2019
f008195
fixed typos
HaritzPuerto Jun 15, 2019
0bff30c
technical doc link changed
HaritzPuerto Jun 15, 2019
0bd5486
Merge pull request #3 from HaritzPuerto/showImages
HongGiwon Jun 15, 2019
ec64db9
Rename
HongGiwon Jun 15, 2019
7fd0672
Rename
HongGiwon Jun 15, 2019
612662d
Delete 07-Rich_Text_Competition-KAIST_old.md
HongGiwon Jun 15, 2019
e02b73d
Rename 07-Rich_Context_Competition-KAIST.md to 07-Rich_Text_Competiti…
HongGiwon Jun 15, 2019
bc07f07
minor edits
philipskokoh Jun 15, 2019
8dedbda
fix hyperlink
philipskokoh Jun 15, 2019
89a876e
restructed and updated paper based on feedback
rrichajalota Jun 17, 2019
b5a8662
revised chapter 5, added lit. review.
jsm296 Jun 18, 2019
95cdb93
Merge pull request #4 from allenai/master
IanMulvany Jun 19, 2019
9b46c4c
Merge pull request #5 from HaritzPuerto/master
IanMulvany Jun 19, 2019
534570e
Merge pull request #6 from philipskokoh/master
IanMulvany Jun 19, 2019
009be24
Merge pull request #7 from dice-group/master
IanMulvany Jun 19, 2019
a6d6e31
new test at merging
IanMulvany Jun 19, 2019
efa0932
updated chapters from bundesbank
IanMulvany Jun 19, 2019
4807855
added tex source file
IanMulvany Jun 19, 2019
b5a92a7
metadata chapters
IanMulvany Jun 20, 2019
1108007
moving file to have easier filename
IanMulvany Jun 20, 2019
21aa4c4
updtaed introduction
IanMulvany Jun 20, 2019
c13f2e7
script to combine chapters
IanMulvany Jun 20, 2019
5e99f7e
version of compiled chapters
IanMulvany Jun 20, 2019
2b001a4
first pass attempted run at combining
IanMulvany Jun 20, 2019
6655d08
readme file to keep track of the conversion process
IanMulvany Jun 21, 2019
121fd26
update
IanMulvany Jun 21, 2019
d454eaf
added separate image files of figures
jsm296 Jun 21, 2019
41799c0
Merge branch 'master' of https://github.com/rich-context-competition/…
jsm296 Jun 21, 2019
03a8098
gesis add gitignore
ottowg Jun 24, 2019
689e573
added bash script for reproducable markdown
ottowg Jun 24, 2019
0d6bc08
added citation to future works
rrichajalota Jun 28, 2019
1282640
Fixed typo in header
dancastellani Jul 1, 2019
ffc8c38
ds chapter
IanMulvany Jul 2, 2019
e488dc9
Merge branch 'master' of https://github.com/rich-context-competition/…
IanMulvany Jul 2, 2019
2b301d8
chapter_break_placeholder.md
IanMulvany Jul 2, 2019
40a1a68
Merge pull request #9 from dice-group/master
IanMulvany Jul 2, 2019
c5acdc3
Merge pull request #10 from dancastellani/patch-1
IanMulvany Jul 2, 2019
2aaadb5
added in placeholder chapter markers
IanMulvany Jul 2, 2019
9f18ee9
updated compile
IanMulvany Jul 2, 2019
33d7e64
updated compile
IanMulvany Jul 2, 2019
fcf3cf7
removing apple converted spaces from chap 1
IanMulvany Jul 2, 2019
0b6e907
compile with TOC from marked
IanMulvany Jul 2, 2019
ad17863
pull in images from chapter 05
IanMulvany Jul 3, 2019
a0b5c57
describe how to compile book, and which artifaact is the key output
IanMulvany Jul 3, 2019
1b0eb39
pulling out images for chapter 3, DS chapter
IanMulvany Jul 3, 2019
ae2d308
utility script to help with images
IanMulvany Jul 3, 2019
d41bfb7
alternate processor to combine images in one dir
IanMulvany Jul 3, 2019
c22ec66
all images in one dir
IanMulvany Jul 3, 2019
2c3a68c
updated compile
IanMulvany Jul 3, 2019
56fa709
adding a Future-of-AI chapter at the end
ceteri Jul 11, 2019
5d8366a
Merge branch 'master' of https://github.com/rich-context-competition/…
ceteri Jul 11, 2019
f18e7ac
updated title for chap13
ceteri Jul 11, 2019
8080b77
reworked closing chapter, to be less about ADRF
ceteri Jul 12, 2019
326a873
copy and compile script includes ch 13
IanMulvany Jul 14, 2019
4db6827
updated how to build the book
IanMulvany Jul 14, 2019
9a2c0a6
updated version
IanMulvany Jul 14, 2019
6b37cc6
updated raw chapters
IanMulvany Jul 14, 2019
c7c302c
updated chap 5
IanMulvany Jul 16, 2019
e8f6d8d
removed ghost chapter closes #23
IanMulvany Jul 16, 2019
34530d9
closes #37
IanMulvany Jul 16, 2019
6af4110
closes #39
IanMulvany Jul 16, 2019
04f2a17
doc to properly name chap 4
IanMulvany Jul 16, 2019
b2a4e24
closes #36
IanMulvany Jul 16, 2019
1584792
closes #33
IanMulvany Jul 16, 2019
06df3c3
closes #34
IanMulvany Jul 16, 2019
c797715
closes #35
IanMulvany Jul 16, 2019
28c0601
updated compiled version
IanMulvany Jul 16, 2019
221bb86
deleted technical help
ottowg Jul 17, 2019
da40f06
Merge branch 'master' of github.com:rich-context-competition/rich-con…
ottowg Jul 17, 2019
9e5a931
renamed target markdown
ottowg Jul 17, 2019
4d41056
deleted technical description from main markdown
ottowg Jul 17, 2019
fb58f75
moved local tex creation gesis
ottowg Jul 17, 2019
aeddcb0
deleted .gitignore from base directory
ottowg Jul 17, 2019
57afbb1
added my pdf creation
ottowg Jul 17, 2019
ce30e02
added information flow as image
ottowg Jul 17, 2019
9d6d178
restructure level and fixing of minor issues
ottowg Jul 17, 2019
46c0b0f
intro changes
ottowg Jul 18, 2019
4f427d6
removed rcc data description
ottowg Jul 18, 2019
bcd080e
Merge pull request #43 from ottowg/master
IanMulvany Jul 18, 2019
721fe3b
renamed folder
ottowg Jul 18, 2019
9d670de
Merge pull request #4 from rich-context-competition/master
HaritzPuerto Jul 19, 2019
9595354
Fix typo
HaritzPuerto Jul 19, 2019
8e684e5
Small changes about dataset problems
HaritzPuerto Jul 19, 2019
648b3d0
small changes
HaritzPuerto Jul 19, 2019
e9bdcbe
Lessons learned research methods small change
HaritzPuerto Jul 19, 2019
8f01116
Research Methods Retrieval removed dataset problem mentions
HaritzPuerto Jul 19, 2019
fbbf18e
revise fig and results
tong-zeng Jul 22, 2019
338d972
last changes to lyx
daniel-acuna Jul 23, 2019
b9766f1
export to pdf, md after daniel's check
tong-zeng Jul 23, 2019
96fc449
fix early stop sentence
tong-zeng Jul 23, 2019
309c45f
Merge pull request #45 from sciosci/master
IanMulvany Jul 23, 2019
a1ddc6a
Merge pull request #44 from HaritzPuerto/master
IanMulvany Jul 23, 2019
5b31387
higher res images for chapter 09
IanMulvany Jul 24, 2019
386ef56
closes #50
IanMulvany Jul 24, 2019
391c3ad
removing trailing label from chapter 06 title
IanMulvany Jul 24, 2019
37d4bdf
closes #41
IanMulvany Jul 24, 2019
46f3d97
better chapter title formatting
IanMulvany Jul 24, 2019
609ad8e
updated compilation
IanMulvany Jul 24, 2019
d0c3a70
my comments
Jul 31, 2019
391dd82
my comments2 :)
Jul 31, 2019
3bdf67b
Added Acknowledgments
HaritzPuerto Aug 2, 2019
b5f43bc
Merge pull request #1 from HaritzPuerto/ack
HaritzPuerto Aug 2, 2019
ea31237
Update 07-Rich_Text_Competition-KAIST.md
HaritzPuerto Aug 2, 2019
dae8375
Update 07-Rich_Text_Competition-KAIST.md
HaritzPuerto Aug 5, 2019
d310f01
Merge branch 'master' of git://github.com/rich-context-competition/ri…
ottowg Aug 5, 2019
7bc0120
Reduce dataset discussion
Aug 5, 2019
0a3adc1
rework intro and research field classifier
ottowg Aug 6, 2019
9277d2c
deleted unused figure
ottowg Aug 6, 2019
c8264cd
Merge pull request #51 from HaritzPuerto/master
IanMulvany Aug 6, 2019
1b0ba65
Merge pull request #52 from allenai/master
IanMulvany Aug 6, 2019
c183cde
removing duplicate image folders
IanMulvany Aug 8, 2019
fc3fe2c
rename markdown chapters to a standard form
IanMulvany Aug 8, 2019
501f44d
remove old naming version of chapters
IanMulvany Aug 8, 2019
2aa5890
ignore bib files
IanMulvany Aug 8, 2019
25d056e
rename combined artifact
IanMulvany Aug 8, 2019
29cb707
add in consistent chapter versions
IanMulvany Aug 8, 2019
2b1f7ff
add sphinx versions to spearaate directory
IanMulvany Aug 8, 2019
1ad82d8
now replaces within file in place
IanMulvany Aug 8, 2019
6afd7ff
new version
IanMulvany Aug 8, 2019
612737d
removing old versions
IanMulvany Aug 8, 2019
5b1b754
removing some tex artifacts
IanMulvany Aug 8, 2019
32e725f
stefans lit
ottowg Aug 20, 2019
0565170
stefans_changes
ottowg Aug 20, 2019
278f03e
fix issues
ottowg Aug 20, 2019
dd745d7
added missing citation (boland2019)
ottowg Aug 20, 2019
90f097b
new markdown
ottowg Aug 20, 2019
953532b
added pdf to git
ottowg Aug 20, 2019
28d8afe
rework pre-pro]
ottowg Aug 20, 2019
844c96b
updated dataset mention extraction
ottowg Aug 20, 2019
30324c1
fixed typo
ottowg Aug 20, 2019
c39b5e4
rework of method extraction
ottowg Aug 22, 2019
697fa90
andreas changes part 1
ottowg Aug 26, 2019
b2d0e2a
added remarks and minor changes from SD
ottowg Aug 27, 2019
ef1e0a3
recreate figures, uncap titles, better eval for fields
ottowg Aug 27, 2019
f9ddeb0
fields added ref to metrics
ottowg Aug 27, 2019
894d820
started discussion
ottowg Aug 28, 2019
fa9651e
added key points for discussion
ottowg Aug 28, 2019
7e67ca7
added discussion
ottowg Aug 30, 2019
693b53b
last remarks from andrea integrated
ottowg Aug 30, 2019
c772698
new title
ottowg Aug 30, 2019
0f7ee4f
new figure
ottowg Sep 4, 2019
0feeb4c
conclusion and smaller issues
ottowg Sep 4, 2019
c8800a4
add figure file
ottowg Sep 4, 2019
ddd8260
changes in discussion
ottowg Sep 4, 2019
3b59a9c
added output
ottowg Sep 4, 2019
5c993c2
corrections from andrea
ottowg Sep 10, 2019
1a03685
Merge branch 'master' of github.com:rich-context-competition/rich-con…
ottowg Sep 10, 2019
a682900
Merge pull request #53 from ottowg/master
IanMulvany Sep 11, 2019
44c66fa
fixing issue where we removed newlines from markdown files
IanMulvany Sep 20, 2019
3bce90d
update description of file
IanMulvany Sep 20, 2019
3778ec8
updated converted version
IanMulvany Sep 20, 2019
fdbe793
pdf version in the right place now
IanMulvany Sep 20, 2019
d955d75
adding MD required for Sphinx preview w/o exceptions
ceteri Oct 31, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 40 additions & 0 deletions 01-Introduction/01-Introduction-Rich Context.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta http-equiv="Content-Style-Type" content="text/css">
<title></title>
<meta name="Generator" content="Cocoa HTML Writer">
<meta name="CocoaVersion" content="1671.5">
<style type="text/css">
p.p1 {margin: 0.0px 0.0px 0.0px 202.6px; font: 10.0px Arial}
p.p2 {margin: 18.0px 0.0px 0.0px 0.0px; font: 12.0px Arial}
p.p3 {margin: 19.9px 0.0px 0.0px 0.0px; font: 12.0px Arial}
p.p4 {margin: 19.7px 0.0px 0.0px 0.0px; font: 12.0px Arial}
p.p5 {margin: 0.0px 0.0px 0.0px 0.0px; font: 12.0px Arial}
p.p6 {margin: 35.5px 0.0px 0.0px 0.0px; font: 12.0px Arial}
p.p7 {margin: 1.7px 0.0px 0.0px 0.0px; text-align: center; font: 12.0px Arial}
p.p8 {margin: 1.7px 0.0px 0.0px 0.0px; text-indent: 31.9px; font: 12.0px Arial}
p.p9 {margin: 1.7px 0.0px 0.0px 31.9px; font: 12.0px Arial}
span.s1 {color: #0563c1}
</style>
</head>
<body>
<p class="p1">Rich Context<span class="Apple-converted-space"> </span></p>
<p class="p2">The social sciences are at a crossroads. The enormous growth of the scientific enterprise, coupled with rapid technological progress, has created opportunities to conduct research at a scale that would have been almost unimaginable a generation or two ago. The rise of cheap computing, connected mobile devices, and social networks with global reach allows researchers to rapidly acquire massive, rich datasets; to routinely fit statistical models that would once have seemed intractably complex; and to probe the way that people think, feel, behave, and interact with one another in ever more naturalistic, fine-grained ways. Yet much of the core infrastructure is manual and ad-hoc in nature, threatening the legitimacy and utility of social science research.<span class="Apple-converted-space"> </span></p>
<p class="p3">We can and must do better. The great challenges of our time are human in nature - terrorism, climate change, the use of natural resources, and the nature of work - and require robust social science to understand the sources and consequences. Yet the lack of reproducibility and replicability evident in many fields(<i>1</i>–<i>5</i>) is even more acute in the study of human behavior both because of the difficulty of sharing confidential data and because of the lack of scientific infrastructure. The central argument we advance in this monograph is that advances in technology—and particularly, in automation—can now change the way in which social science is done. Social scientists have eagerly adopted new technologies in virtually every area of social science research—from literature searches to data storage to statistical analysis to dissemination of results.<span class="Apple-converted-space"> </span></p>
<p class="p4">A major challenge is search and discovery. The vast majority of social science data and outputs cannot be easily discovered by other researchers even when nominally deposited in the public domain. A new generation of automated search tools could help researchers discover how data are being used, in what research fields, with what methods, with what code and with what findings. And automation can be used to reward researchers who validate the results and contribute additional information about use, fields, methods, code, and findings.(<i>6</i>)<span class="Apple-converted-space"> </span></p>
<p class="p4">In sum, the use of data depends critically on knowing how it has been produced and used before: the required elements what do the data <b><i>measure</i></b>, what <b><i>research </i></b>has been done by what <b><i>researchers, </i></b>with what <b><i>code</i></b>, and with what <b><i>results</i></b>. Acquiring that knowledge has historically been manual and inadequate. The challenge is particularly acute in the case of confidential data on human subjects, since it is impossible to provide fully open access to the source files.<span class="Apple-converted-space"> </span></p>
<p class="p3">This monograph provides pathbreaking contributions of different approaches to automating the collection and codification of knowledge from publications and people. Each paper summarizes technological approaches to applying text analysis techniques on a series of different publication corpora to identify the datasets referenced in each publication and draw out the required elements. The authors have been identified as a result of an international competition that<span class="Apple-converted-space"> </span></p>
<p class="p5">challenged computer scientists to find ways of automating the discovery of research datasets, fields &amp; methods behind social science research publications.. They are 1. <span class="s1">GESIS </span>: Wolfgang Otto, Katarina Boland, Dimitar Dimitrov, Behnam Ghavimi, Narges Tavakolpoursaleh, Andrea Zielinski, Karam Abdulahhad 2. <span class="s1">KAIST</span>: Haritz Puerto San Roman, Hong Giwon, Cao Minh Son 3. <span class="s1">Paderborn University</span>: Rricha Jalota, Nikit Srivastava, Daniel Vollmers, René Speck, Michael Röder,Dr. Ricardo Usbeck, Prof. Dr. Axel-Cyrille, Ngonga Ngomo 4. <span class="s1">Allen AI</span>: Waleed Ammar, Christine Betts, Daniel King, Iz Beltagy<span class="Apple-converted-space"> </span></p>
<p class="p4">We also will have a contribution from Daniel Acuna, Syracuse University<span class="Apple-converted-space"> </span></p>
<p class="p3">We envision additional contributions from the technical judges as well as the social science judges.<span class="Apple-converted-space"> </span></p>
<p class="p6">1. C. F. Camerer <i>et al.</i>, Evaluating the replicability of social science experiments in Nature<span class="Apple-converted-space"> </span></p>
<p class="p7">and Science between 2010 and 2015. <i>Nat. Hum. Behav. </i><b>2</b>, 637 (2018). 2. A. Dafoe, Science deserves better: the imperative to share complete replication files. <i>PS<span class="Apple-converted-space"> </span></i></p>
<p class="p8"><i>Polit. Sci. Polit. </i><b>47</b>, 60–66 (2014). 3. J. P. A. Ioannidis, Why Most Published Research Findings Are False. <i>PLoS Med</i>. <b>2</b>, e124<span class="Apple-converted-space"> </span></p>
<p class="p8">(2005). 4. N. Young, J. Ioannidis, O. Al-Ubaydli, Why Current Publication Practices May Distort<span class="Apple-converted-space"> </span></p>
<p class="p8">Science. <i>PLoS Med </i>(2008). 5. G. Christensen, E. Miguel, Transparency, reproducibility, and the credibility of economics<span class="Apple-converted-space"> </span></p>
<p class="p8">research. <i>J. Econ. Lit. </i><b>56</b>, 920–980 (2018). 6. T. Yarkoni <i>et al.</i>, “Enhancing and accelerating social science via automation: Challenges<span class="Apple-converted-space"> </span></p>
<p class="p9">and Opportunities” (2019).<span class="Apple-converted-space"> </span></p>
</body>
</html>
97 changes: 97 additions & 0 deletions 01-Introduction/01-Introduction-Rich Context.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,97 @@
Rich Context[ ]{.Apple-converted-space}

The social sciences are at a crossroads. The enormous growth of the
scientific enterprise, coupled with rapid technological progress, has
created opportunities to conduct research at a scale that would have
been almost unimaginable a generation or two ago. The rise of cheap
computing, connected mobile devices, and social networks with global
reach allows researchers to rapidly acquire massive, rich datasets; to
routinely fit statistical models that would once have seemed intractably
complex; and to probe the way that people think, feel, behave, and
interact with one another in ever more naturalistic, fine-grained ways.
Yet much of the core infrastructure is manual and ad-hoc in nature,
threatening the legitimacy and utility of social science
research.[ ]{.Apple-converted-space}

We can and must do better. The great challenges of our time are human in
nature - terrorism, climate change, the use of natural resources, and
the nature of work - and require robust social science to understand the
sources and consequences. Yet the lack of reproducibility and
replicability evident in many fields(*1*--*5*) is even more acute in the
study of human behavior both because of the difficulty of sharing
confidential data and because of the lack of scientific infrastructure.
The central argument we advance in this monograph is that advances in
technology---and particularly, in automation---can now change the way in
which social science is done. Social scientists have eagerly adopted new
technologies in virtually every area of social science research---from
literature searches to data storage to statistical analysis to
dissemination of results.[ ]{.Apple-converted-space}

A major challenge is search and discovery. The vast majority of social
science data and outputs cannot be easily discovered by other
researchers even when nominally deposited in the public domain. A new
generation of automated search tools could help researchers discover how
data are being used, in what research fields, with what methods, with
what code and with what findings. And automation can be used to reward
researchers who validate the results and contribute additional
information about use, fields, methods, code, and
findings.(*6*)[ ]{.Apple-converted-space}

In sum, the use of data depends critically on knowing how it has been
produced and used before: the required elements what do the data
***measure***, what ***research*** has been done by what
***researchers,*** with what ***code***, and with what ***results***.
Acquiring that knowledge has historically been manual and inadequate.
The challenge is particularly acute in the case of confidential data on
human subjects, since it is impossible to provide fully open access to
the source files.[ ]{.Apple-converted-space}

This monograph provides pathbreaking contributions of different
approaches to automating the collection and codification of knowledge
from publications and people. Each paper summarizes technological
approaches to applying text analysis techniques on a series of different
publication corpora to identify the datasets referenced in each
publication and draw out the required elements. The authors have been
identified as a result of an international competition
that[ ]{.Apple-converted-space}

challenged computer scientists to find ways of automating the discovery
of research datasets, fields & methods behind social science research
publications.. They are 1. [GESIS ]{.s1}: Wolfgang Otto, Katarina
Boland, Dimitar Dimitrov, Behnam Ghavimi, Narges Tavakolpoursaleh,
Andrea Zielinski, Karam Abdulahhad 2. [KAIST]{.s1}: Haritz Puerto San
Roman, Hong Giwon, Cao Minh Son 3. [Paderborn University]{.s1}: Rricha
Jalota, Nikit Srivastava, Daniel Vollmers, René Speck, Michael Röder,Dr.
Ricardo Usbeck, Prof. Dr. Axel-Cyrille, Ngonga Ngomo 4. [Allen AI]{.s1}:
Waleed Ammar, Christine Betts, Daniel King, Iz
Beltagy[ ]{.Apple-converted-space}

We also will have a contribution from Daniel Acuna, Syracuse
University[ ]{.Apple-converted-space}

We envision additional contributions from the technical judges as well
as the social science judges.[ ]{.Apple-converted-space}

1\. C. F. Camerer *et al.*, Evaluating the replicability of social
science experiments in Nature[ ]{.Apple-converted-space}

and Science between 2010 and 2015. *Nat. Hum. Behav.* **2**, 637 (2018).
2. A. Dafoe, Science deserves better: the imperative to share complete
replication files. *PS[ ]{.Apple-converted-space}*

*Polit. Sci. Polit.* **47**, 60--66 (2014). 3. J. P. A. Ioannidis, Why
Most Published Research Findings Are False. *PLoS Med*. **2**,
e124[ ]{.Apple-converted-space}

(2005). 4. N. Young, J. Ioannidis, O. Al-Ubaydli, Why Current
Publication Practices May Distort[ ]{.Apple-converted-space}

Science. *PLoS Med* (2008). 5. G. Christensen, E. Miguel, Transparency,
reproducibility, and the credibility of
economics[ ]{.Apple-converted-space}

research. *J. Econ. Lit.* **56**, 920--980 (2018). 6. T. Yarkoni *et
al.*, "Enhancing and accelerating social science via automation:
Challenges[ ]{.Apple-converted-space}

and Opportunities" (2019).[ ]{.Apple-converted-space}
Loading