Elitist Jerks - How to get XML with PHP from armory

Elitist Jerks (http://elitistjerks.com/forums.php)

- Public Discussion (http://elitistjerks.com/f15/)

- - How to get XML with PHP from armory (http://elitistjerks.com/f15/t14035-how_get_xml_php_armory/)

How to get XML with PHP from armory

*Update*

Since my old tutorial files are lost I made some new ones.

You can check them out here:
php_ajax_armory_tutorial - rothui - Google Code

Three files are needed.
- A basic PHP file that does the structure and includes links that will call your AJAX function
guild_data.php - rothui - Google Code

- Some JavaScript functions to retrieve stuff
armory.js - rothui - Google Code

- Another PHP file that is called by the AJAX function and retrieves the information for you
get_char_data_xml.php - rothui - Google Code

As some posts on page 3 already have mentioned we are now using a class that contains the retrieved information.

If your webserver does not support CURL you can try this function to get the XML string instead. If it does support CURL you should make use of it.

PHP Code:


		
			
  function get_xml_data_from_url($url,$lang)

  {        

    $url_array = parse_url($url);

    $fp = fsockopen($url_array['host'], 80, $errno, $errstr, 5); 

    $send = "GET " . $url_array[path] . "?" . $url_array[query] ." HTTP/1.0\r\n";

    $send .= "Host: " . $url_array[host] . " \r\n";

    $send .= "User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)\r\n";

    $send .= "Accept-Language: " . $lang . "\r\n";

    $send .= "Connection: Close\r\n\r\n";

    fwrite($fp, $send);

    while ($fp && !feof($fp))

    {

      $headerbuffer = fgets($fp, 1024);

      if (urlencode($headerbuffer) == "%0D%0A")

      {

        break;

      }

    }

    $xml_data = '';

    while (!feof($fp))

    {

      $xml_data .= fgets($fp, 1024);

    }

    fclose($fp);

    return $xml_data;

  }

Remember: If you do not support the Request with a browser information the response will be HTML and not XML always. So if you want an XML response add some kind of user agent information. But sometimes HTML is wanted, tooltips for example.

Oh btw...Don't spam the armory server with requests or you will find yourself banned temporarily shortly after.

Thanks for this. I had originally intended to do some playing with data from the Armory but PHP (and web development in general) is not something I have much experience with so I never got sufficiently motivated to do it. I think this will give me the impetus to have another go as it means I don't need to spend ages working out how to get the data and concentrate on the manipulation of it.

Just to give you some quick example what can be done:

http://dm.next-gen.org/files/item_to...980&lang=fr-fr
http://dm.next-gen.org/files/item_to...980&lang=de-de
http://dm.next-gen.org/files/item_to...980&lang=en-en

Source:
http://dm.next-gen.org/files/item_tooltip_xml.html

So you could have tooltips for every item id you want in multiple languages with just one little script that you could call with AJAX in real time.

If you want to lookup for items per "name", no problem. I want every item with "onslaught" in it. (beware of browser language!)
http://armory.worldofwarcraft.com/se...uery=Onslaught

Ok now with the php script:
http://dm.next-gen.org/files/item_qu...en&q=onslaught
http://dm.next-gen.org/files/item_qu...de&q=onslaught
http://dm.next-gen.org/files/item_qu...fr&q=onslaught

Just have the query string you are searching for behind the "q=".

Source:
http://dm.next-gen.org/files/item_query_xml.html

Thats it.

I admit I haven't done any XML parsing yet, but did you take a look at http://www.php.net/manual/en/ref.xml.php?

You should be able to read XML files without having to convert them.

BTW, those links don't work for me:
http://dm.next-gen.org/files/item_qu...en&q=onslaught

Quote:

Originally Posted by sp00n (Post 410751)

BTW, those links don't work for me:
http://dm.next-gen.org/files/item_qu...en&q=onslaught

Like in you can't connect or you just get a blank page? If it's the latter you need to look at the source of the page: View->Source code or something like that.

I'm getting the following error, but it's probably because I don't know what I'm doing.

http://phparmory.sourceforge.net/ or http://sourceforge.net/projects/phparmory/ is a parse I found around the net that puts everything into php arrays. It's pretty neat and easy to add in your own code (if you know a bit of PHP). I added in some code to get Arena Teams for use on my guilds under dev new layout and it works nice.

I use cURL to pull down the xml and simplexml to parse it for my guilds roster page. Requires PHP5, which most webhosts haven't switched to (including our host). I run the script below on my desktop that has PHP5, it parses the info I need and puts it into a mysql database at our host. Then on our hosts server with PHP4, roster.php parses the data from the mysql database.

PHP Code:


		
			
#!/usr/bin/php

<?php



class roster_gen {



 const BROWSER="Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.2) Gecko/20070319 Firefox/2.0.0.3";



 public $query;

 public $server;

 public $guild;

 public $guildie;

 public $page;



public function __construct ( $query, $server, $guild, $guildie, $page ) {

    $this->query = $query;

    $this->server = $server;

    $this->guild = $guild;

    $this->guildie = $guildie;

    $this->page = $page;

 } // end of __construct()



public function pull_xml() {



    if( $this->query === 'roster' ){

        $url = 'http://armory.worldofwarcraft.com/guild-info.xml?r=' . $this->server . '&n=' . $this->guild . '&p=' . $this->page;

        

      }elseif( $this->query === 'character' ){

        $url = 'http://armory.worldofwarcraft.com/character-sheet.xml?r=' . $this->server . '&n=' . $this->guildie;

        

        }



    $ch = curl_init();

    curl_setopt ($ch, CURLOPT_URL, $url);

    curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);

    curl_setopt ($ch, CURLOPT_CONNECTTIMEOUT, 15);

    curl_setopt ($ch, CURLOPT_USERAGENT,  roster_gen::BROWSER);

    

    $url_string = curl_exec($ch);

    return simplexml_load_string($url_string);

    

    curl_close($ch);

 } // end of pull_xml()



} // end class



// query, realm, guild, guildie, page

// query can be roster or character

$roster = new roster_gen (roster, cenarius, insurrection, NULL, 1);



$xml_roster = $roster->pull_xml();

$battlegroup = $xml_roster->guildInfo->guild['battleGroup'];

$num_guildies = $xml_roster->guildInfo->guild->members['memberCount'];



$roster->query=character;

$name = 'someguildie';  //change to character you'd like to lookup

$roster->guildie=$name;

$xml_char = $roster->pull_xml();



$tree1 = $xml_char->characterInfo->characterTab->talentSpec['treeOne'];

$tree2 = $xml_char->characterInfo->characterTab->talentSpec['treeTwo'];

$tree3 = $xml_char->characterInfo->characterTab->talentSpec['treeThree'];

            

$lastLOGIN =  $xml_char->characterInfo->character['lastModified'];

            

$title =  $xml_char->characterInfo->character['title'];



echo "Guild:$roster->guild Realm:$roster->server Battlegroup:$battlegroup\n";

echo "Name:$name($title), Talents:$tree1/$tree2/$tree3 Last Login: $lastLOGIN\n";

?>

If you do a var_dump($xml_char) or var_dump($xml_roster) you'll see all the options you can pull from the armory.

Hope this is helpful.

I was mucking around testing with Firefox, IE7 and Safari for Windows today and I happened to notice Safari is awesome for using the armory (mostly). Firefox and IE7 will choke/lock up on the large xmlhttprequests and not respond until they have finished loading/processing the page. Safari however will let you carry on no problems, opening new tabs etc while the armory is loading in the background tab.

It's a pain Safari doesn't render text white in input boxes though :(

Quote:

Originally Posted by Pomperipossa (Post 410837)

Like in you can't connect or you just get a blank page? If it's the latter you need to look at the source of the page: View->Source code or something like that.

Huh, yeah.
Weird, normally Firefox displays the XML data and doesn't just put out a blank page.

Quote:

Originally Posted by Asmik (Post 410922)

I'm getting the following error, but it's probably because i don't know what I'm doing.

The XML data is not for viewing in your browser :), its for your php scripts.
So it doesn't matter that you do not see nothing.

Just look into the source to see the XML.

The Armory XML is very very fast, what makes the application so slow is all the AJAX crap. It just eats the browser alive >_<.

@renew
Thanks for the link I will take a closer look at this one. I am now at the point where I have to transfer the XML data into PHP arrays.

Thanks for the insight zork. I'll begin the c# asp.net port shortly. There's probably already one out there but I'm bored.

Quote:

Originally Posted by Melnor (Post 411641)

Thanks for the insight zork. I'll begin the c# asp.net port shortly. There's probably already one out there but I'm bored.

Code:

static HttpWebRequest RequestBuilder(string requestUri, string currentPage, string referer, string address)

        {

                Cookie cookieOne = new Cookie("currentPage", currentPage);

                Cookie cookieTwo = new Cookie("cookies", "true");

                Cookie cookieThree = new Cookie("cookieMenu", "all");



                cookieOne.Domain = address;

                cookieTwo.Domain = address;

                cookieThree.Domain = address;



                CookieContainer thisContainer = new CookieContainer();



                thisContainer.Add(cookieThree);

                thisContainer.Add(cookieTwo);

                thisContainer.Add(cookieOne);



                HttpWebRequest request = (HttpWebRequest)WebRequest.Create(requestUri);



                request.Accept = "*/*";

                request.Headers.Add(HttpRequestHeader.AcceptLanguage, "en-us");

                request.Headers.Add("US-CPU", "x86");

                request.UserAgent = "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.0.04506; .NET CLR 1.1.4322)";

                request.Referer = referer;

                request.CookieContainer = thisContainer;



                return request;

        }

The ugly hacked up function I wrote a while back to form a request object with the required parameters to get the xml back.

I would call it like:

Code:

HttpWebRequest request = RequestBuilder("http://" + address + "/guild-info.xml?r=" + serverName + "&p=1&n=" + guildName + "&lang=", @"guild-info.xml%3Fr%3D" + serverName + "%26n%3D" + guildName + "%26p%3D1", @"http://" + address + "/#guild-info.xml?r=" + serverName + "&n=" + guildName + "&p=1", address);

Used for http://www.thepalsforlife.com/ftp/ArmoryParse/. If you're offended by the word faggot, that link will most likely be extremely offensive.

EDIT: I attached the source to my armory parse. It's pretty ugly and completely devoid of comments since it's something I hacked up in an afternoon and never really bothered with again. Hopefully someone can get some value out of the source however.

I just want to give you an update on this to show what amazing stuff can be done.

I built our own item search based on the Armory XML, take a look :)

All data is generated in real time, no database is used.

p.s. I couldn't use the phparmory XML parser, sadly it had a bug with XML attributes. But i found another one that worked properly and nearly the same.

Quote:

Originally Posted by zork (Post 414629)

p.s. I couldn't use the phparmory XML parser, sadly it had a bug with XML attributes. But i found another one that worked properly and nearly the same.

What did you end up using? I was starting to use phpArmory, but if it's bugged, I should either look at fixing it or just change to something else.