Scraping Therapeutic Antibody Database
1
0
Entering edit mode
9.1 years ago

Good afternoon.

Has anybody experienced scraping the http://tabs.craic.com database? I'm trying to use Python for that purpose, but my code won't work:

import requests
from requests import HTTPBasicAuth

page = requests.get("http://tabs.craic.com/sequences/1.html", auth=HTTPBasicAuth("my_name", "my_passw"))
print page.text

I'm legal user, i.e I've access token and all the rights, but the page I'm trying to access is not what I wanted. Is there something wrong with my code?

scraping Python TABS • 2.5k views
ADD COMMENT
0
Entering edit mode

http://tabs.craic.com/static_pages/3 "You may NOT transfer data from the Service using automated scripts or other automated data transfer software with express written permission from Craic Computing."

ADD REPLY
1
Entering edit mode

The wording of that clause suggests you can transfer data as long as you don't have written permission. I wouldn't do it, but...that is a bad typo.

ADD REPLY
0
Entering edit mode
4.5 years ago
liangj • 0

I suppose commercial databases just don't welcome your scraping. It could even be illegal.

Try these

Thera-SAbDab
http://opig.stats.ox.ac.uk/webapps/newsabdab/therasabdab/search/ free NIH https://antibodies.cancer.gov/browse free Tabs
https://tabs.craic.com paid/trial IMGT
http://www.imgt.org/mAb-DB/ free Kabat
http://www.abysis.org/ free AdisInsight http://www.adisinsight.com/ paid

ADD COMMENT

Login before adding your answer.

Traffic: 1880 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6