Page 1 of 1

eqlist download?

PostPosted: Wed Feb 08, 2012 12:38 pm
by Stark
I'm pretty sure that there used to be a downloadable version of the eqlist, but that it was taken down due to excessive bandwidth abuse. (if I'm remembering correctly)

Is there any way we could have some way of obtaining a local copy of the eqlist? (in whatever format is relevant) Even if I just have to e-mail a request to someone. I'd like to be able to use it to do some fancy filtering, sorting, and script integration that isn't possible with the web only eqlist.

Thanks! :)

Re: eqlist download?

PostPosted: Wed Feb 08, 2012 3:32 pm
by Stark
Found where Breeze commented on the topic from a year old thread:

I would do a complete export weekly or so in xml format which could be downloaded and parsed by the clients but on the old eqlist when i did that people just linked to it directly instead of caching it which caused a ton of traffic since some moron(s) had it automatically look up every item he(they) saw, which downloaded a huge xml file each time.


Soo... Breeze, any chance we could still get this in a way that can't be abused by stupid people? :)

Re: eqlist download?

PostPosted: Wed Feb 08, 2012 8:18 pm
by Spink
I would also be interested in working with a local copy of eqlist.

I'm currently using a version I cobbled together from the old eqlist interface, but it's rather out of date.

Re: eqlist download?

PostPosted: Thu Mar 08, 2012 7:58 am
by celerra7
I've been working on this idea for a while now. I've taken blank queries of each category and saved them as HTML. There seems to be a limitation to either the web or db that won't display all items when doing the blank query to the category ALL.

I've found the table structure in the HTML and parsed through it to get all the pertinent information, then saved into an SDF file. The problem I run into is not all the query tables are the same - books, potions, and scrolls are different from other eq tables - the MOB and affects/bonus divisions are reversed.

Is there any further action from the im's to either allow a full listing of eq with the blank ALL query, or a weekly or monthly export posted here?

Thanks in advance for any input. Love the game and keep the freshness going.

Re: eqlist download?

PostPosted: Fri Mar 09, 2012 6:07 am
by *Breeze*
i would be willing to temporarily remove the limit (yes there is a hard limit. i forget what i set it to)
and/or do an xml output of everything thats there.

however, my terms are ::
  • if you do anything cool with it you have to show me ;)
  • be willing to share whatever you come up with
  • don't complain if certain eq is missing (yes there is eq that is set to not load on purpose)
  • don't complain if i kill whatever xml interface i come up with due to server load

i did start writing an API for the eqlist which allows you to query the eqlist from a url,
but i didn't finish it due to lack of time, and frankly, i got kind of pissed off when
someone (not even an immortal!) TOLD me that i need to do something else before
doing the API stuff.

I will look at it and see what the current status is, but iirc the api itself is done, just the
xml output needs to be designed along with the 'how to query it' part.

it was something like


to search it.


Re: eqlist download?

PostPosted: Fri Mar 09, 2012 12:39 pm
by blackmore
It sure as hell wasn't me, I would love an api. :)

Re: eqlist download?

PostPosted: Sun Dec 16, 2012 10:47 pm
by raincrab
me too


Re: eqlist download?

PostPosted: Mon Jan 28, 2013 4:50 pm
by celerra7
I've come back around to looking at this, and I'm running into the limit inside specific categories now. Sloth provides so many cool items, the XML DB output limit is reached.

For instance, search LOW for ioun's pulls up the standard 4 (plus some). But search LOW {blank} returns a nice list, but only the Blue is shown of the standard 4. Thus I am assuming the DB limit is being hit in output.

I would also love a list of "known" items and attributes. Not asking for specials, quest items, undiscovered, etc.

BTW, thanks to all the work the Imms do!


Re: eqlist download?

PostPosted: Sat Oct 26, 2013 1:59 pm
by celerra7
Bumping this.

I want to use the eqlist output as part of my client coding. Still don't mind having to do a blank query per slot and pull from the webpage output, but again, the xml search is hitting a limit in output - example Query Low (no params) doesn't show all iouns available, since coders have given us so many items we can use LOW.

Thanks for any consideration / help with this.

Re: eqlist download?

PostPosted: Mon Dec 16, 2013 3:56 am
by *Breeze*
xml is not gonna happen.

i did do a csv search output from the eqlist that you can download and do whatever you want with, but i am not going to do xml direct queries/output. it is too much work on my side for something that i would just get complaints from anyways, get ticked off and disappear for another year.

i am also considering doing a full eqlist export into json on a weekly basis that you can download and import into your client databases but i don't want people linking their clients directly to the eqlist. causes way too many issues with webhost.

from json you can convert to xml and upload to your own webserver or something.

Re: eqlist download?

PostPosted: Mon Dec 16, 2013 7:40 am
by *Breeze*
json is done. Just need to link it later.

Re: eqlist download?

PostPosted: Mon Dec 16, 2013 12:50 pm
by celerra7
Weekly updated export would be awesome. In no way want to put burden on you or tax the systems we have. Really appreciate you responding to the bump and finding a solution. Thanks for all your efforts.

Re: eqlist download?

PostPosted: Mon Dec 16, 2013 12:56 pm
by *Breeze*
celerra, feel free to email me and i can send you a copy of the weekly file to get started with til i figure out how to link it to the website. feel free to email me. all immortals have emails.