Pure XML Blog

Transform XML using PHP DOMDocument and XslProcessor

nospam@example.com (gcd5137) — Tue, 02 Aug 2011 12:59:09 -0400

The sample code below can to transform XML using XSL using PHP.

First, set up the XSL processor and stylesheet.

$xp = new XsltProcessor();
$xsl = new DOMDocument();
$xsl->load("my-xsl-file.xsl");
$xp->importStylesheet($xsl);

Next, load the XML file to be transformed.

$xml = new DOMDocument();
$xml->load("xml-to-transform.xml");

Lastly, transform the XML and display the result.

$html = $xp->transformToXML($xml);
echo $html;

Transform RSS XML into plist for iOS

nospam@example.com (gcd5137) — Thu, 28 Apr 2011 12:25:42 -0400

I was working on an iPhone app project and found it to be much easier to load a .plist file than to go through the trouble of downloading and parsing an RSS feed. Luckily RSS is XML and so is a .plist file so XSLT to the rescue. Let's walk through the XSL.

As usual, check the namespaces in the input and add them to your XSL. In this case, I was pulling from the New York Times which was full of them.

<xsl:stylesheet version="1.0"

exclude-result-prefixes="pheedo nyt media atom dc"

xmlns:xsl="http://www.w3.org/1999/XSL/Transform"

xmlns:dc="http://purl.org/dc/elements/1.1/"

xmlns:media="http://search.yahoo.com/mrss/"

xmlns:atom="http://www.w3.org/2005/Atom"

xmlns:nyt="http://www.nytimes.com/namespaces/rss/2.0

xmlns:pheedo="http://www.pheedo.com/namespace/pheedo">

Next, set some of the important output options.

<xsl:output method="xml" indent="yes"

doctype-public="-//Apple//DTD PLIST 1.0//EN"

doctype-system="http://www.apple.com/DTDs/PropertyList-1.0.dtd"

encoding="ISO-8859-1" />

The encoding attribute prevents some unwanted character conversions which will prevent XCode from loading it. I'm still not sure the best way to handle the character encoding.

The root template will output the plist wrapper. I mocked up the plist first in XCode to get an idea for what the resulting XML should look like.

<xsl:template match="/">

<array>

<xsl:apply-templates select="/rss/channel/item" />

</array>

</plist>

</xsl:template>

Now create the item template. This is not the most robust XSL but it works for the purposes of demonstrating the concept. I also deleted some additional output elements for the sake of brevity.

<xsl:template match="item">

<dict>

<key>title</key>

<xsl:value-of select="title" />

</string>

<xsl:value-of select="link" />

</string>

<key>image</key>

<xsl:value-of select="image" />

</string>

</dict>

</xsl:template>

Run that through your xsl processor and you should see output similar to below.

<?xml version="1.0" encoding="ISO-8859-1"?>

<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">

<array>

<dict>

<key>title</key>

<string>Seattle Journal: Long After Microsoft, Allen and Gates Cast Shadows Over City</string>

<string>http://feeds.nytimes.com/click.phdo?i=5b4fa1b8abefd39cd4eaa299314d0a29</string>

<key>image</key>

</dict>

...more content here

</array>

</plist>

Getting antlib to work - looping through files in a directory

nospam@example.com (gcd5137) — Tue, 06 Apr 2010 16:08:04 -0400

I was working with Apache Ant and came across antlib, which offers some cool extensions and seemed to be the right tool for what I needed to do. Here's how I got it to work. First, I had to update my version of Ant to 1.8 (or later). Next, I added the namespace to my ant build XML file <project> element.

xmlns:antcontrib="antlib:net.sf.antcontrib">

Then, I declared the extension using typedef.

I ended up using the namespaced approach because it worked on the first try. In this case, I was looping through a directory and getting information about the files.

<antcontrib:foreach param="file" target="file-info">
    <path>
        <fileset dir="${src.dir}">
            <filename name="${file.type}"/>
        </fileset>
    </path>
</antcontrib:foreach>

The target "file-info" gets called for each file specified in the path. See ant and antlib docs for more info.

Configuring PHP Proxy with JSON web service

nospam@example.com (gcd5137) — Mon, 29 Mar 2010 10:04:46 -0400

I was working on an AJAX web application and got stuck on a problem trying to get my php proxy to use the Digg web service to provide results in json format. After reading the Digg API docs, I ended up solving the problem using curl instead of file_get_contents, as you might with HTML or XML. See curl setopt below, more specifically CURLOPT_HTTPHEADER and CURLOPT_USERAGENT.

        $curl_handle = curl_init();
        curl_setopt($curl_handle, CURLOPT_RETURNTRANSFER, true);
        curl_setopt($curl_handle, CURLOPT_URL, $_GET['url']);
        curl_setopt($curl_handle , CURLOPT_HTTPHEADER, array(
            "Accept: application/json",
            "Content-Type: application/json"
        ));
        curl_setopt($curl_handle, CURLOPT_USERAGENT, "My-Application/2.5");
        $content = curl_exec($curl_handle);
        curl_close($curl_handle);

This solved the problem and now works as expected with Firefox, Chrome, and IE.

Generating UUIDs with XSL and Java

nospam@example.com (gcd5137) — Fri, 05 Mar 2010 15:19:03 -0500

Sample code showing how to generate unique IDs using XSL and Java. I am running Saxon 9 and Java 1.6.

First, set up the xmlns:uuid extension at the stylesheet level.

<xsl:stylesheet version="2.0"
xmlns:xsl="http://www.w3.org/1999/XSL/Transform"
xmlns:uuid="java:java.util.UUID">

Later on, create a random unique ID using the uuid extension.

<xsl:variable name="uid" select="uuid:randomUUID()"/>

Output the value of the unique ID.

<xsl:value-of select="$uid"/>

I like to set up an attribute set to reuse.

    <xsl:attribute-set name="uid">
        <xsl:attribute name="id">
            <xsl:variable name="uid" select="util:randomUUID()"/>
            <xsl:value-of select="$uid"/>
        </xsl:attribute>
    </xsl:attribute-set>

And then reference it when creating the result.

<some-element xsl:use-attribute-sets="uid"/>

Exporting XML from Oracle using Java ResultSet

nospam@example.com (gcd5137) — Tue, 14 Jul 2009 14:10:34 -0400

I have done this with PHP before, but needed to do it again using similar logic with Java and XSL. The purpose was to extract information from an Oracle database. This is the meat of the Java function body, which loops through a SQL query ResultSet object and returns an XML document (minus the exception handling). I then write that XML Doc to an output file. The 'cols' attribute was just for debugging.

            DocumentBuilder docBuilder = builderFactory.newDocumentBuilder();
            Document doc = docBuilder.newDocument();
            Element results = doc.createElement("Results");
            doc.appendChild(results);

            ResultSetMetaData rsmd = rs.getMetaData();

            int colCount = rsmd.getColumnCount();
            results.setAttribute("cols", Integer.toString(colCount));

            // loop through the result set
            while (rs.next()) {
                // create a row element for each item
                Element row = doc.createElement("Row");
                results.appendChild(row);

                // loop through the columns
                for (int i = 1; i <= colCount; i++) {
                    String columnName = rsmd.getColumnName(i);
                    Object value = rs.getObject(i);

                    // watch out for wrong index or null values
                    Element node = doc.createElement(columnName);
                    if (value != null) {
                        node.appendChild(doc.createTextNode(value.toString()));
                        row.appendChild(node);
                    }
                    else{
                        node.appendChild(doc.createTextNode("null"));
                        row.appendChild(node);
                    }
                }
            }

Transforming XML to SQL using XSL

nospam@example.com (gcd5137) — Fri, 01 May 2009 16:53:10 -0400

I recently came across a project that required me to take a bunch of XML and put it into MySQL, a relational database system. I thought about the easiest way to migrate the data without too much manual effort. I launched jEdit, my current XSL development tool of choice, and started writing some templates.

First, I had to set the output to text and handle whitespace.

<xsl:output method="text" indent="no"/>

<xsl:strip-space elements="*"/>

<xsl:template name="NewLine">
<xsl:text>
</xsl:text>
</xsl:template>

I set up some templates to match my input XML elements and spit out the appropriate SQL statements.

<xsl:template match="topics/record">
   <xsl:call-template name="NewLine"/>
   <xsl:call-template name="NewLine"/>
   <xsl:call-template name="NewLine"/>

   <xsl:text>insert into quiz_topics values(</xsl:text>
   <xsl:text>null, </xsl:text>
   <xsl:apply-templates select="@topic"/>
   <xsl:text>, </xsl:text>
   <xsl:apply-templates select="@status"/>
   <xsl:text>);</xsl:text>
</xsl:template>

<xsl:template match="@*">
   <xsl:text>"</xsl:text>
   <xsl:value-of select="."/>
   <xsl:text>"</xsl:text>
</xsl:template>

The resulting output is a SQL script I can use to automatically load the data into MySQL. I used phpMyAdmin to manage the database tables and import the SQL output from my XSL transform. This worked like a charm and saved me hours of time!

Using DOMXPath with PHP

nospam@example.com (gcd5137) — Tue, 07 Apr 2009 09:09:44 -0400

I stumbled upon some very helpful information on php.net yesterday while working with PHP, XML, and DOM. The DOMXpath class makes working with XML way easier, especially when you need more complex features than SimpleXml. The function below accepts a DOMDocument and XPath string as input parameters and returns a DOMNodeList, which you can easily iterate over almost as if it were an array.

    public static function getNodes($dom, $xpathString){
       $xpath = new DOMXpath($dom);
       $nodes = array();
       $nodes = $xpath->evaluate($xpathString);
       return $nodes;
    }

Here's a simple example. You need to make up some XML and adjust the XPath as necessary.

$file = "data.xml";
$dom = new DomDocument();
$dom->load($file);

$xpath = new DOMXpath($dom);

$nodes = $xpath->evaluate("//title");

foreach($nodes as $node){
$nodeValue = $node->nodeValue;
echo "<p>$nodeValue</p>";
}

Using Catalogs with Saxon

nospam@example.com (gcd5137) — Tue, 10 Mar 2009 23:10:32 -0400

Here's an XSL tip that I use quite a bit and is very handy. If you are working with XML that uses DTDs or Schemas, you most likely need to resolve the SYSTEM or PUBLIC identifiers that are used for any required resources. Most Java XSL processors, like Saxon, allow you to use the apache commons resolver to add support for Catalogs and resolve those identifiers.

java -cp "saxon.jar;resolver.jar;" net.sf.saxon.Transform -x org.apache.xml.resolver.tools.ResolvingXMLReader -y org.apache.xml.resolver.tools.ResolvingXMLReader -r org.apache.xml.resolver.tools.CatalogResolver -o result.out input.xml style.xsl

Your CatalogManager.properties should also be on the classpath and might look something like this.

catalogs=catalog.xml;C:/somepath/catalog
relative-catalogs=true
catalog-class-name=org.apache.xml.resolver.Resolver
verbosity=2

And your XML catalog might look like this.

<?xml version="1.0"?>
<catalog>
    <public
            publicId="-//My Company//DTD My DTD Name and Version//EN"
            uri="C:/path-to-dtd/my.dtd"/>
</catalog>

Keep your content out of attributes

nospam@example.com (gcd5137) — Sun, 08 Mar 2009 21:00:18 -0400

When creating an XML DTD or Schema, a developer often needs to decide when to use an element or attribute. These types of decisions can impact the project success. Here are a few questions that might help you make the decision.

Does the tag or attribute contain data or content that be presented to the customer? If so, use an element.

Is the markup used for metadata, or information about the content? If so, use an attribute.

Are there datatype restictions that need to be used? You have a lot more options when using schemas. DTDs may tempt you to use attributes for data type validation.

Will the text ever need to be translated? If so, use an element.

An example of why such decisions are important is shown when trying to work with XML that contains translated text in attribute values. The XML spec does not allow reserved characters (i.e. &) or entities (i.e. é) in attribute values, so prepare for all kinds of problems. Parsers will complain, stylesheet processors will fail, publishing engines will throw exceptions, and lots of time will be spent trying to resolve the problem.

There are many more questions to ask, but these should help make the decision easier.

Backing up data using Ant

nospam@example.com (gcd5137) — Sat, 07 Mar 2009 00:14:40 -0500

Today I realized my 70GB hard drive was almost completely full (yikes!) and I quickly decided to back up old files and do some maintenance. As I started mindlessly copying files, I realized I had a lot of .svn folders scattered everywhere. As much as I love subversion, I don't want to save all those extra files. Just the source please. Realizing it could become tedious to weed out those .svn folders and files, I decided to use my 'Swiss army knife'. Apache Ant is one of my favorite tools for a lot of reasons, including its ease of use and integration with Eclipse. The ant task below will copy files from an input directory to an output directory except for those unwanted svn folders.

I also decided to do some clean up and after backing up files, delete ones on my hard drive that are old. The ant task below will delete any files within the given input folder that were modified before the date time provided.

My Seagate external hard drive comes with some nice configuration options, but I love the granular level of control ant provides. Just be careful when using the delete task!!

My First Entry

nospam@example.com (gcd5137) — Sat, 07 Mar 2009 00:06:58 -0500

Welcome to my web blog