iranvorti.blogg.se

#FMINER REGEX CODE#
#FMINER REGEX DOWNLOAD#

Actions Connections and Execution Flow.

Some useful javascript function: data.indexOf // find sub string postionĭata.lastIndexOf //find last sub string postionĭata.split //split string, for example, data.split('\n') will return the first lineĪnd you can also use regular expression to adjust data.įor example, we scraped organization information in one block like this: XXXX Center, LLCĪnd we need split them to Name, Address, City, State, Zipcode, PhoneNumber, we can write the script like this:

#FMINER REGEX CODE#

You will get Another example: We scraped "price:100$", and we want to just need"100", we can write javascript code like this: i = data.indexOf(':') For example, if you captured and javascript code like this: data.substring(7) The scraped data is a variable of "data", and the last line of the javascript codes returned value will be as the result data. When checked it, you can change the captured data with javascript. If you assign a data table in its ancestor "scrape page" node, you can select a column field to keep this value.Īdjust Data with Javascript (for Pro/Mac version) Save a static data here, and you can also set an inputted data(format as or ), see input data. It must contain parentheses, FMiner will extract string in brackets. Screenshot: Create screenshot of the page, and save it to the folder.Įxtract data from the target's HTML code with a "regular express", For example: scrape email address.

#FMINER REGEX DOWNLOAD#

Wait download: Wait download is for some special situation and the program will wait until some download request(e.g a page has a button, when click button something will be downloaded).Image: Download image of the selected target.Link: Download file from the link of the target.Here you should assign a folder to hold the downloaded files. The default setting is for text, however, you have a number of options include the element's HTML, DOM attribute, page attribute, download elements and regular expression, static data.Ĭapture Dom attribute of the target(s), here you should input the attribute name(e.g. href, class.).įor example, if you want to scrape URL of a link, set it to "href" if you want to scrape URL of a image, set it to "src". Use the extract type selector to specify which attribute in the selected DOM(s) is to be extracted. Assign which DOM on pages will be captured. It notifies the program that you wish to extract specific data elements from the page. Capture content nodes are nodes in "scrape page" nodes to assign which content will be captured and will be saved into which column.