Automated search of NCBI Pubmed databases
Here is how I search NCBI PubMed using script.
1, Write a script in Perl or Java to search pubmed by date and keyword.
2, If there is “next” link on the result page, let script to click on “next” link until there is no more “next” link.
3, extract abstract link from search result pages
4, pause 15~ 25 seconds between each click.
5, click each abstract page, make sure efetch is used, e.g.,
http://eutils.ncbi.nlm.nih.gov/entrez/eutils/efetch.fcgi?db=pubmed&id=19501051&retmode=xml
http://eutils.ncbi.nlm.nih.gov/entrez/eutils/efetch.fcgi?db=pmc&id=2708341
6, parse abstract using an XML parser.