Welcome! Click to reach the link!


About Me
 
In China
 In Germany
 In USA
 My Resume
  
Publications
 
Books
 Technical Papers
 Theses
 Others
 
Info Tech
 
A Move To IT
 
Courses Attended
 Certificates
 Software Projects
 
FEM Simulation
 
Engineering
 
Work and Study
 Courses Attended
 Process Modeling
 
Photo Album
 
China
 Germany
 Ph.D. defence/celeb.
 
Miner Parade
 USA
 Scenic & Architecture
 
Hobbies
 
Resources Links


 

| Home | About Me | Publications | Info Tech | Engineering | Hobbies | Resource Links |

[Resume] [Books] [Technical Papers] [Software Projects] [FEM Simulation] [Process Modeling]

 


URL Parser

It's a valuable tool to collect online URLs from any website, such as Yahoo. When the root URL of a website is given, the tool will access the website, read it's HTML code and retrieve all the URLs. Then for each URL starting with the root URL (such as www.yahoo.com/software.htm starting with www.yahoo.com) it repeats the action to retrieve all URLs recursively from the page. All the retrieved URLs and related information will be saved into a database.

This tool was initially developed using www.steellinks.com as target site, which is with nearly 4000 URLs. It took about half an hour, for example, to download all URLs of a the website www.steellinks.com into a local database.

 

 

 


  You are welcome to contact me. Send e-mail to me if you want.

 
© Benjamin (Bingji) Li 2000. All rights reserved.