It's worth looking at lxml.objectify.
xml = """<main>
<object1 attr="name">content</object1>
<object1 attr="foo">contenbar</object1>
<test>me</test>
</main>"""
from lxml import objectify
main = objectify.fromstring(xml)
main.object1[0] # content
main.object1[1] # contenbar
main.object1[0].get("attr") # name
main.test # me
Or the other way around to build xml structures:
item = objectify.Element("item")
item.title = "Best of python"
item.price = 17.98
item.price.set("currency", "EUR")
order = objectify.Element("order")
order.append(item)
order.item.quantity = 3
order.price = sum(item.price * item.quantity for item in order.item)
import lxml.etree
print(lxml.etree.tostring(order, pretty_print=True))
Output:
<order>
<item>
<title>Best of python</title>
<price currency="EUR">17.98</price>
<quantity>3</quantity>
</item>
<price>53.94</price>
</order>
Answer from Peter Hoffmann on Stack OverflowIt's worth looking at lxml.objectify.
xml = """<main>
<object1 attr="name">content</object1>
<object1 attr="foo">contenbar</object1>
<test>me</test>
</main>"""
from lxml import objectify
main = objectify.fromstring(xml)
main.object1[0] # content
main.object1[1] # contenbar
main.object1[0].get("attr") # name
main.test # me
Or the other way around to build xml structures:
item = objectify.Element("item")
item.title = "Best of python"
item.price = 17.98
item.price.set("currency", "EUR")
order = objectify.Element("order")
order.append(item)
order.item.quantity = 3
order.price = sum(item.price * item.quantity for item in order.item)
import lxml.etree
print(lxml.etree.tostring(order, pretty_print=True))
Output:
<order>
<item>
<title>Best of python</title>
<price currency="EUR">17.98</price>
<quantity>3</quantity>
</item>
<price>53.94</price>
</order>
I've been recommending this more than once today, but try Beautiful Soup (easy_install BeautifulSoup).
from BeautifulSoup import BeautifulSoup
xml = """
<main>
<object attr="name">content</object>
</main>
"""
soup = BeautifulSoup(xml)
# look in the main node for object's with attr=name, optionally look up attrs with regex
my_objects = soup.main.findAll("object", attrs={'attr':'name'})
for my_object in my_objects:
# this will print a list of the contents of the tag
print my_object.contents
# if only text is inside the tag you can use this
# print tag.string
Parse XML file into Python object - Stack Overflow
How do I convert XML to HTML in python? - Stack Overflow
A simple python3 library to convert JSON into XML via file, URL or string.
Converting .txt with RGB values to .xml or .qml?
Videos
If you have an appropriate XML Schema for these XML files, there are tools like GenerateDS which will generate python classes based on them.
That would allow you to load all of the files in memory, and have them as objects. How you then store that data elsewhere...well, you don't say what you want to do, but you could do anything you usually can with python.
Use the standard xml.etree.Element tree to extract the information from XML to Python objects (or the more enhanced third party lxml with the same API).
I recommend to read the Mark Pilrim's Dive Into Python 3, Chapter 12. XML (http://getpython3.com/diveintopython3/xml.html).
Here is the core of how the parser/compiler could be written. The idea is to go recursively through the elements, collect the neccessary information and output the code when it is possible:
import xml.etree.ElementTree as ET
class Parser:
def __init__(self):
self.output_list = [] # collected output lines
self.il = 0 # indentation level
def __iter__(self):
return iter(self.output_list)
def out(self, s):
'''Output the indented string to the output list.'''
self.output_list.append(' ' * self.il + s)
def indent(self, num=1):
'''Increase the indentation level.'''
self.il += num
def dedent(self, num=1):
'''Decrease the indentation level.'''
self.il -= num
def parse(self, elem):
'''Call the parser of the elem.tag name.
The tag name appended to "parse_" and then the name of that
function is called. If the function is not defined, then
self.parse_undefined() is called.'''
fn_name = 'parse_' + elem.tag
try:
fn = getattr(self, fn_name)
except AttributeError:
fn = self.parse_undefined
return fn(elem)
def loop(self, elem):
'''Helper method to loop through the child elements.'''
for e in elem:
self.parse(e)
def parseXMLfile(self, fname):
'''Reads the XML file and starts parsing from the root element.'''
tree = ET.parse(fname)
script = tree.getroot()
assert script.tag == 'script'
self.parse(script)
###################### ELEMENT PARSERS #######################
def parse_undefined(self, elem):
'''Called for the element that has no parser defined.'''
self.out('PARSING UNDEFINED for ' + elem.tag)
def parse_script(self, elem):
self.loop(elem)
def parse_stage(self, elem):
self.out('')
self.out('Parsing the stage: ' + elem.attrib['id'])
self.indent()
self.loop(elem)
self.dedent()
def parse_initialise(self, elem):
self.out('')
self.out('#---------- ' + elem.tag + ' ----------')
self.loop(elem)
def parse_variable(self, elem):
tt = str # default type
if elem.attrib['type'] == 'Integer':
tt = int
# elif ... etc for other types
# Conversion of the value to the type because of the later repr().
value = tt(elem.attrib['value'])
id_ = elem.attrib['id']
# Produce the line of the output.
self.out('{0} = {1}'.format(id_, repr(value)))
def parse_execute(self, elem):
self.out('')
self.out('#---------- ' + elem.tag + ' ----------')
self.loop(elem)
def parse_if(self, elem):
assert elem[0].tag == 'condition'
condition = self.parse(elem[0])
self.out('if ' + condition + ':')
self.indent()
self.loop(elem[1:])
self.dedent()
def parse_condition(self, elem):
assert len(elem) == 0
return elem.text
def parse_then(self, elem):
self.loop(elem)
def parse_else(self, elem):
self.dedent()
self.out('else:')
self.indent()
self.loop(elem)
def parse_error(self, elem):
assert len(elem) == 0
errorID = elem.attrib.get('errorID', None)
fieldID = elem.attrib.get('fieldID', None)
self.out('error({0}, {1})'.format(errorID, fieldID))
def parse_setNextStage(self, elem):
assert len(elem) == 0
self.out('setNextStage --> ' + elem.text)
if __name__ == '__main__':
parser = Parser()
parser.parseXMLfile('data.xml')
for s in parser:
print s
When used with the data pasted here http://pastebin.com/vRRxfWiA, the script produces the following output:
Parsing the stage: stage1
#---------- initialise ----------
taxyear = 2012
taxyearstart = '06/04/2012'
taxyearend = '05/04/2013'
previousemergencytaxcode = '747L'
emergencytaxcode = '810L'
nextemergencytaxcode = '810L'
...
maxLimitAmount = 0
PARSING UNDEFINED for executeMethod
if $maxLimitReached$ == True:
employeepayrecord = 'N'
employeepayrecordstate = '2'
else:
employeepayrecordstate = '1'
gender = ''
genderstate = '1'
title = ''
forename = ''
forename2 = ''
surname = ''
dob = ''
dobinvalid = ''
#---------- execute ----------
if $dobstring$ != "":
validDOBCheck = 'False'
PARSING UNDEFINED for executeMethod
if $validDOBCheck$ == False:
error(224, dob)
else:
minimumDOBDate = ''
PARSING UNDEFINED for executeMethod
validDOBCheck = 'False'
PARSING UNDEFINED for executeMethod
if $validDOBCheck$ == False:
error(3007161, dob)
if $dobstring$ == "01/01/1901":
error(231, dob)
else:
error(231, dob)
Parsing the stage: stage2
#---------- initialise ----------
address1 = ''
...
My beloved SD Chargers hat is off to you if you think a regex is easier than this:
#!/usr/bin/env python
import xml.etree.cElementTree as et
sxml="""
<encspot>
<file>
<Name>some filename.mp3</Name>
<Encoder>Gogo (after 3.0)</Encoder>
<Bitrate>131</Bitrate>
</file>
<file>
<Name>another filename.mp3</Name>
<Encoder>iTunes</Encoder>
<Bitrate>128</Bitrate>
</file>
</encspot>
"""
tree=et.fromstring(sxml)
for el in tree.findall('file'):
print '-------------------'
for ch in el.getchildren():
print '{:>15}: {:<30}'.format(ch.tag, ch.text)
print "\nan alternate way:"
el=tree.find('file[2]/Name') # xpath
print '{:>15}: {:<30}'.format(el.tag, el.text)
Output:
-------------------
Name: some filename.mp3
Encoder: Gogo (after 3.0)
Bitrate: 131
-------------------
Name: another filename.mp3
Encoder: iTunes
Bitrate: 128
an alternate way:
Name: another filename.mp3
If your attraction to a regex is being terse, here is an equally incomprehensible bit of list comprehension to create a data structure:
[(ch.tag,ch.text) for e in tree.findall('file') for ch in e.getchildren()]
Which creates a list of tuples of the XML children of <file> in document order:
[('Name', 'some filename.mp3'),
('Encoder', 'Gogo (after 3.0)'),
('Bitrate', '131'),
('Name', 'another filename.mp3'),
('Encoder', 'iTunes'),
('Bitrate', '128')]
With a few more lines and a little more thought, obviously, you can create any data structure that you want from XML with ElementTree. It is part of the Python distribution.
Edit
Code golf is on!
[{item.tag: item.text for item in ch} for ch in tree.findall('file')]
[ {'Bitrate': '131',
'Name': 'some filename.mp3',
'Encoder': 'Gogo (after 3.0)'},
{'Bitrate': '128',
'Name': 'another filename.mp3',
'Encoder': 'iTunes'}]
If your XML only has the file section, you can choose your golf. If your XML has other tags, other sections, you need to account for the section the children are in and you will need to use findall
There is a tutorial on ElementTree at Effbot.org
Use ElementTree. You don't need/want to muck about with a parse-only gadget like pyexpat ... you'd only end up re-inventing ElementTree partially and poorly.
Another possibility is lxml which is a third-party package which implements the ElementTree interface plus more.
Update Someone started playing code-golf; here's my entry, which actually creates the data structure you asked for:
# xs = """<encspot> etc etc </encspot"""
>>> import xml.etree.cElementTree as et
>>> from pprint import pprint as pp
>>> pp([dict((attr.tag, attr.text) for attr in el) for el in et.fromstring(xs)])
[{'Bitrate': '131',
'Encoder': 'Gogo (after 3.0)',
'Frame': 'no',
'Frames': '6255',
'Freq.': '44100',
'Length': '00:02:43',
'Mode': 'joint stereo',
'Name': 'some filename.mp3',
'Quality': 'good',
'Size': '5,236,644'},
{'Bitrate': '0', 'Name': 'foo.mp3'}]
>>>
You'd probably want to have a dict mapping "attribute" names to conversion functions:
converters = {
'Frames': int,
'Size': lambda x: int(x.replace(',', '')),
# etc
}
One way to achieve this is to use XSLT Transformation. Most programming languages including Python will have support to convert an XML document into another document (e.g. HTML) when supplied with an XSL.
A good tutorial on XSLT Transformation can be found here
Use of Python to achieve transformation (once an XSL is prepared) is described here
There are several things wrong with your XHTML source. First, xmlns is not a correct attribute for the xml declaration; it should be put on the root element instead. And the root element for XHTML is <html>, not <xhtml>. So the valid XHTML input in this particular case would be
<?xml version=\"1.0\"?>\n<html xmlns=\"http://www.w3.org/1999/xhtml\">\n<head><title></title></head>\n<body>\n</body></html>
That said, I'm not sure if xml.etree.ElementTree accepts that, having no experience with it.