You'll need to have an account that can access the LikedIn Sales Navigator
IMPORTANT: If the software asks you whether to install to
PATH
, chooseYES
-
Install Anaconda from Official Website
https://repo.continuum.io/archive/Anaconda3-5.0.1-Windows-x86_64.exe
-
Install Firefox® from Mozilla's official website
https://www.mozilla.org/en-US/firefox/new/
-
Install Git for windows
https://git-scm.com/download/win
-
Open a command line
by pressingCMD + R
then entercmd
-
Clone the Git Repository
git clone https://gitlab.com/XetRAFHan/linkedinspider.git
-
Change directory to program folder
cd linkedinproject
-
Create a new Anaconda® environment
conda create --name linkedin python=3.6
-
Activate Anaconda® environment
activate linkedin
-
Install Python dependencies from pypi
pip install -r requirement_windows.txt
-
Install Scrapy from Anaconda
conda install -c conda-forge scrapy
-
Open a Firefox Browser
-
Run the program
windows_start.bat
-
Enter your LinkedIn Sales Navigator Account
-
You may need to pass the reCAPCHA
-
Enter your LinkedIn Sale Navigator URL
If your don't know what is a LinkedIn Sales Navigator, Please check this Youtube Video Introduction (->)
Here is an example LinkedIn Sales Navigator URL
https://www.linkedin.com/sales/search?keywords=CEO&facet=G&facet=I&facet=CS&facet.G=us%3A70&facet.I=43&facet.CS=D&facet.CS=G&count=25&start=0&updateHistory=true&searchHistoryId=2107126404&trackingInfoJson.contextId=1809E16E40A8F114008596FB612B0000
- Patiently wait for your result in
output
folder - Remember to delete
temp
folder when scraping had finished
It's highly recommended to run any spider on a cloud instance. (The Internet connection speed will be much better)
- Install Git for Ubuntu
sudo apt-get install -y git
- If your Ubuntu Doesn't have a desktop environment, you should install a GNOME.
sudo apt-get install -y lubuntu
sudo reboot
- Clone the Git Repository
git clone https://gitlab.com/XetRAFHan/linkedinspider.git
- Change directory to program folder
cd linkedinproject
- Install dependencies
bash ubuntu_dependencies.sh
- Install pip dependencies
sudo pip3.6 install -r requirement.txt
- Open a Firefox Browser
- Run the program
bash ubuntu_start.sh
- Enter your LinkedIn Sales Navigator Account
- You may need to pass the reCAPCHA
- Enter your LinkedIn Sale Navigator URL
- Patiently wait for your result in
output
folder - Remember to delete
temp
folder when scraping had finished
Title | Name | First Name | Last Name | Time in role | Contact Linkedin Profile URL | Contact Location | Company | Company Size (Employees) | Industry | Company Profile Linkedin URL | Company Website | ID | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
CEO & president | ZhiXing Zhe | ZhiXing | Zhe | 10 years and 3 months in role xxxx | https://www.twitter.com/xxxx | https://www.linkedin.com/sal/zhixingzhe | Great China | ZhongGuo DianXin | 50 - 100 | telecommunications | https://www.linkedin.com/sal/xxxx | https://www.somecompany.com/ | 0 based |