You only get to read a file once, unless you go back to the beginning. But this isn't how you want to do it regardless.
Iterate the file line-by-line, checking for your conditions.
error = False
report = False
with open(html_path) as html_file:
for line in html_file:
print(line)
if 'Error' in line:
error = True
if 'Report' in line:
report = True
print(line)
else:
if error:
print('error')
elif report:
print('result')
else:
print('nothing')
Top answer 1 of 3
5
I'd recommend using a library such as Beautiful Soup if it's HTML you want to parse. No need for regex.
EDIT
Using the URL you just added, this is the sample code to get the HTML object out:
import BeautifulSoup
import re
import urllib
data = urllib.urlopen('http://listadecasamento.fastshop.com.br/ListaCasamento/ListaCasamentoBusca.aspx?Data=2013-06-07').read()
soup = BeautifulSoup.BeautifulSoup(data)
element = soup.find('span', attrs={'class': re.compile(r".*\btxt_resultad_busca_casamento\b.*")})
print element.text
This will find the HTML span element on the page that has the class txt_resultad_busca_casamento, which I believe is the data you're trying to extract. From there you can just parse the .text attribute to get the exact data you're interested in.
EDIT 2
Oops, just realised that uses regular expressions... it seems class matching in BeautifulSoup isn't perfect! This line should work instead, at least until the site changes their HTML:
element = soup.find('div', attrs={'id': 'ctl00_body_uppBusca'}).find('span')
2 of 3
1
Given that you can't parse html with regular expression, if you treat your file as a bag of text you have to use regex or something like:
a = 'Resultado de Busca: Foram encontrados 264 casais' #your page text
num = int(a[a.index("encontrados")+len("encontrados"):a.index("casais")])
Python
docs.python.org › 3 › library › html.parser.html
html.parser — Simple HTML and XHTML parser
Source code: Lib/html/parser.py This module defines a class HTMLParser which serves as the basis for parsing text files formatted in HTML (HyperText Mark-up Language) and XHTML. Example HTML Parser...
TutorialsPoint
tutorialspoint.com › python_data_science › python_reading_html_pages.htm
Python - Reading HTML Pages
We can extract tag value from all the instances of a tag using the following code. import urllib2 from bs4 import BeautifulSoup response = urllib2.urlopen('http://tutorialspoint.com/python/python_overview.htm') html_doc = response.read() soup = BeautifulSoup(html_doc, 'html.parser') for x in soup.find_all('b'): print(x.string)
Top answer 1 of 2
2
As snakecharmerb said, by using
for line in html :
you iterate over the characters of html when it's a string, not the lines. But you can use
for line in html.split("\n") :
to iterate over the lines.
2 of 2
1
In the requests package response.content is a string, so you should search like this:
if find in html:
# do something
By iterating over response.content with
for line in html
you are iterating over the individual characters in the string, not lines.
Medium
mateuszwiza.medium.com › text-extraction-from-html-by-keyword-using-python-6b4b5bc1364e
Text Extraction from HTML by Keyword using Python | by Mateusz Wiza | Medium
June 19, 2021 - To make it more clear, let’s assume that we have HTML code <p> Very <b> important </b> piece of code </p>. The resulting list of text strips would then have 3 elements and would look like this: ['Very', 'important', 'piece of code']. Such a format of results is useful in some cases (remember our second task?) but if we’re interested in the entire text from the HTML file, we can just concatenate all these strips of text into a super-long, single string. The final step is to divide this super-long string into pieces with at most 32,767 characters but this is also quite straightforward. We can use the fact that in Python each character in a string has its own index.
Apify
docs.apify.com › web scraping basics with python
Locating HTML elements with Python | Academy | Apify Documentation
We'll use BeautifulSoup to find those HTML elements which contain details about each product, such as title or price. In the previous lesson we've managed to print text of the page's main heading or count how many products are in the listing. Let's combine those two.
Stack Overflow
stackoverflow.com › questions › 55705747 › searching-a-html-file-line-by-line-for-a-string
python 3.x - searching a html file line by line for a string - Stack Overflow
April 16, 2019 - The break statement should be inside if line is '<html>':, so that the for loop is only broken when there's a match. Lines in the file include line breaks (and may include white-spaces). Use line.strip() to remove trailing characters. The is operator does not not test whether two variables have the same value, but whether they point to the same object. Use == to compare values. ... def search(): with open('cate.html') as ht: for cnt, line in enumerate(ht): print(line.strip()) if cnt < 4: if line.strip() == '<html>': print("found") break
Top answer 1 of 2
3
Try the below code:
num_occ = source.count("your_specific_word")
2 of 2
0
So if are looking for a web scraping tool then go with beautiful soup or scrapy
Else you could just calculate the count by the number of occurrences in the text by simply using count
with urlopen(url) as response:
source = response.read()
noOfOccurances = source.count(searchWord)
Python string count
The Hitchhiker's Guide to Python
docs.python-guide.org › scenarios › scrape
HTML Scraping — The Hitchhiker's Guide to Python
(We need to use page.content rather than page.text because html.fromstring implicitly expects bytes as input.) tree now contains the whole HTML file in a nice tree structure which we can go over two different ways: XPath and CSSSelect.
Stack Overflow
stackoverflow.com › questions › 44005897 › search-for-something-in-a-html-string-via-python
Search for something in a HTML-String via Python - Stack Overflow
I use split() to search strings like that. Isolate that third line then ... to get "#1244587 - 16 ..." then since you know that the left numbers will always have 7 digits, you can take that string and do string[1:7] to get the left number.
GeeksforGeeks
geeksforgeeks.org › how-to-find-a-html-tag-that-contains-certain-text-using-beautifulsoup
How to find a HTML tag that contains certain text using BeautifulSoup ? - GeeksforGeeks
January 12, 2024 - In this example, BeautifulSoup is used to search gfg.html for specific text patterns in different HTML tags, and the found tags are printed to the console. ... # Importing library from bs4 import BeautifulSoup import re # Opening and reading the html file file = open("gfg.html", "r") contents = file.read() soup = BeautifulSoup(contents, 'html.parser') # Finding a pattern(certain text) pattern = 'Geeks For Geeks' # Anchor tag text1 = soup.find_all('a', text=pattern) print(text1) # Span tag text2 = soup.find_all('span', text=pattern) print(text2) # Finding a pattern(certain text) pattern2 = 'Python Program' # Heading tag text3 = soup.find_all('h1', text=pattern2) print(text3) # List tag text4 = soup.find_all('li', text=pattern2) print(text4) # Finding a pattern(certain text) pattern3 = 'GFG Website' # Table(row) tag text5 = soup.find_all('tr', text=pattern3) print(text5)
Opensource.com
opensource.com › article › 18 › 1 › parsing-html
Parsing HTML with Python | Opensource.com
If I could scan through all the HTML files for image references, then compare that list to the actual image files, chances are I would see a mismatch. ... I'm interested in the part between the first set of quotation marks, after src=. After some searching for a solution, I found a Python module called BeautifulSoup.
GeeksforGeeks
geeksforgeeks.org › how-to-parse-local-html-file-in-python
How to parse local HTML file in Python? - GeeksforGeeks
March 16, 2021 - In Python, we can parse the html files using the panda's library and the library which is beautiful soup. The Beautiful Soup library is mainly used for web scraping.
GeeksforGeeks
geeksforgeeks.org › how-to-scrape-data-from-local-html-files-using-python
How to Scrape Data From Local HTML Files using Python? | GeeksforGeeks
April 21, 2021 - BeautifulSoup is a Python package used for parsing HTML and XML documents, it creates a parse tree for parsed paged which can be used for web scraping, it pulls data from HTML and XML files and works with your favorite parser to provide the ...
Stack Overflow
stackoverflow.com › questions › 25234217 › in-python-how-do-i-search-an-html-webpage-for-a-set-of-strings-in-text-file
beautifulsoup - In Python, how do I search an html webpage for a set of strings in text file? - Stack Overflow
August 11, 2014 - The problem is that you are trying to search with a string that contains some special character, like ' ', and '\n'. Note that str.strip() removes ' ' and other whitespace characters as well (e.g. tabs and newlines), so, update the following line: ... def textsearch(): #manga_file = open("managa.txt").readlines() ##assuming your text file has 3 titles manga_file = ["Karakuri Circus","Sun-ken Rock","Shaman King Flowers"] manga_html = "https://www.mangaupdates.com/releases.html" manga_page = urllib2.urlopen(manga_html) found = 0 soup = BeautifulSoup(manga_page) ##use BeautifulSoup to parse the s
Real Python
realpython.com › python-web-scraping-practical-introduction
A Practical Introduction to Web Scraping in Python – Real Python
December 21, 2024 - One way to extract information from a web page’s HTML is to use string methods. For instance, you can use .find() to search through the text of the HTML for the <title> tags and extract the title of the web page.
Stack Abuse
stackabuse.com › guide-to-parsing-html-with-beautifulsoup-in-python
Guide to Parsing HTML with BeautifulSoup in Python
September 21, 2023 - This article will give you a crash course on web scraping in Python with Beautiful Soup - a popular Python library for parsing HTML and XML.