Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New ElasticSearch Schema driven by a new MySQL->E.S. driver #17

Open
cobookman opened this issue May 29, 2013 · 1 comment
Open

New ElasticSearch Schema driven by a new MySQL->E.S. driver #17

cobookman opened this issue May 29, 2013 · 1 comment

Comments

@cobookman
Copy link
Collaborator

As the JDBC ElasticSearch (E.S.) river is causing lots of pain w/our OIT setup, I'm writing a new driver to push MySQL data to E.S. This differs from the JDBC E.S. river which pulls the data. If I do this right the frontend could also pull from ElasticSearch using a REST API and/or have a decent public API.

As the old driver didn't like complex JSON I'm thinking of changing the 'schema' to be:

Courses
"_index" = "course"
"_type" = "undergrad" (graduate)
"_id" = "courseID"

example documentURL = http://localhost:9200/course/MATH1502

example document:
{ "department" : "Math",
"number" : 1502,
"name" : "Calculus 2",
"description" : "This class will go over......etc",
"gpa" : 4.0,
"professors" : { "Morley, Tom" : { "GPA" : 4.0, "profid" : "MORLEYTOM" },
"Last, First" : { "GPA" : 2.1, "profid" : "LASTFIRST" },
}
}

Professor
"_index" = "professor"
"_type" = ...not sure what to put here yet....
"_id" = "profID"

example documentURL = http://localhost:9200/proffessor/BLOUGHDOUGLASM

example document:
{
"name" : "Douglas M, Blough",
"undergrad" : {
"gpa" : 3.8,
"courses" : {
"ECE 3020" : { "gpa" : 4.0, "courseid" : "ECE3020" } ,
"ECE 2030" : { "gpa" : 2.0, "courseid" : "ECE2030" }
}
},
"graduate" : {
"gpa" : 3.2,
"courses" : {
"ECE 4445" : { "gpa" : 4.0}
}
}
}

@cobookman
Copy link
Collaborator Author

Should also interface w/Oscar:
https://oscar.gatech.edu/pls/bprod/bwckctlg.p_disp_course_detail?cat_term_in=201308&subj_code_in=CS&crse_numb_in=1371

cat_term_in = Current Semester/Year code
subj_code_in = CS, MATH, ECE, ...etc. (Department)
crse_numb_in = Course Number

Should be fairly easy to interface with.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant