Sunday, 25 February 2007

Introducing the new Wikipedia TomeRaider file.

Hooray!

We have just finished the first cut of the new Wikipedia TR3 file and it really rocks. A few years ago Eric Zachte converted the entire Wikipedia text to TR2 and then to TR3. You can still download or get on CD the files from Eriks website (see below).


But as the wiki grows it becomes more and more cumbersome to handle and the returns of relevance diminish with this growth, it is also now over that SD important 1 gigabyte mark. So, last month we made a decision which is to supply regular cuts of the full Wikipedia text but only the introductory paragraph and then a link to the online article for those who want to read.

It works really well:

  • The files is less than 250 megs so it will fit on most SD cards.
  • It is super fast to browse and index search, even with 1.3+ million entries.

There are some text errors in the file, and to be honest there probably always will be – that’s a drawback of a content source written by so many people. But we will be doing regular updates and constantly removing glitches ion the text. If you find and “significant repeaters” then drop us an email at the Yadabyte support address.

We currently have these cuts of the Wikipedia data, all available for immediate download:

  1. Wikipedia (226 MB) - This is the new file which holds the first paragraph of the articles, all 1.3+ million of them. For most people this will be the most useful. (File Version 01)
  2. Wikipedia Complete (1.1 GB +) - various cuts made by Erik Zachte. Its, contains the full wikipedia with full articiles
  3. Wikipedia Compact (49MB) - For this one we took a number of indexes from various encylopedia sources, merged them and then compared against the wikipedia. Close to a traditional encyclopedia in terms of scope.
Download TomeRaider for Pocket PC, palm OS, WM5, Windows etc at www.tomeraider.com
Email support issues to support at www.yadabyte.com.

Thanks:)

52 comments:

Hedy said...

When I cliked to download the file, I keep getting redirected to the same page.

mstpc said...

None of the download links work. I'd really love to try this again. Please fix the links!

Also, three suggestions:

1) 2 gb SD cards are less than $20 shipped at places like newegg.com and buy.com, so I can't see why most people wouldn't want the full text version. (at least until the picture/graphic version is updated, see below)

2) I did try TR3 briefly and had one major complaint that was a deal-breaker for me. If it hasn't been fixed already, tops on your priority list (besides fixing the download links) should be making a version that scrolls up and down with the "up" and "down" buttons of a handheld. When I'd tried TR3 on my Axim, it was the one thing that drove me nuts about the software -- you had these wonderfully comprehensive articles on Wikipedia in the palm of your hand, yet to scroll down through them you couldn't just hit the "down" button with your thumb -- you had to continually tap the scrollbar on the screen to see the rest of the article. It would be so much easier if one-handed operation were supported via the hardware buttons that are built-in to every handheld!

3) Last but not least, I'd really like to see an updated wikipedia version with pictures and graphics. There is one out there, but it's from Dec 2005. Even though it would need an 8gb card, SD and CF 8GB cards are less than 90 dollars shipped now. From what I can gather, the decision to update this version is not in tomeraider's hands, but FWIW, myself and a bunch of my friends would really like to see a 2007 version as soon as is realistically possible.

mstpc said...

I did a little searching and found the page to download the various versions of wikipedia for PocketPC's and Palms, here it is:

snipurl.com/tomewiki
(Handheld Wikipedias)

Peter said...
This comment has been removed by the author.
Mat Ripley said...

Hi Folks, especially MSPC.


Regarding your points:

1) The full text version is available. Its not made by us however.
2) We use left and right to move through the article list and up and down to go through the hyperlinks. Hows this?
3) So would we. Adding the images exponentially adds to the work. But your right, a new once would be great.

We are uploading the latest as I speak.

Thanks

Mat Ripley

Juan Manuel said...

I'd also support 100% a new, full text + images version, as stated by mstpc

In dec-2005 Erik Zachte already offered a 4GB version for 21 euros, the size of the images being 275 pixels, so and update of the wikipedia for PPC would require 8GB or maybe a 4GB version with smaller images (130 pixels?)

the problem is, Erik seems to be unable to do that process right now because he's working in several projects, and even though he stated the dec05 version wasn't that old in comparison with new editions of paper encyclopedias (2 years), I think it'd be about time to get an up-to-date version :-)

will be waiting for your news

Hamish MacDonald said...

I'm a registered user of TomeRaider, and I have to say that the new beta is a very nice improvement. The interface is very clean, and it's much more straightforward navigating around the Wikipedia now (the search bar used to keep disappearing on me before, and clicking on the button wouldn't bring it back). Thanks!

Paul said...

I would as a minimum want the full text. I can live without graphics but the text is important to me. I have a 4GB card and these are so cheap now so there's no pressure to keep it down to 1GB anymore.

michael said...

What a shame. I'm still waiting for the bug fixing of copying text function. It used to work on my old WM2003 PDA, but not on my new WM5 PDA Phone.

wikipedialover said...

I'm really sad to see that we no longer have the full version of wikipedia (with no cut-down of text or image). I wanted the full version so badly that I bought a PDA with 12 GB storage (Dopod U1000) and is just about to order the full image full text version but see that you only have a condensed version.

Can you bring back the full version with full image please?

Paul said...

Get the version with the whole articles. It's only ~5x bigger than the abstracts only version but is a hundred times as usefull. For example, if you are looking up Mel Gibson, then you probably already now he is an actor, which is basically all the abstract will tell you. Sometimes the first paragraph only clarifies something (ex. it has been suggested that this page should be joined with another, telling you nothing about the entry). In conclusion, don't download the 250 MiB abstract version, for the dozen or so people I know that have (including myself) ended up deleting it due of its uselessness (it's not even worth burning onto a 5 cent CD).

RealEstate said...

I love this !!! I use it on my iPaq 4155 all the time...

* where can I get the very latest release?

* I would very much want to see a version with images...

* up to which date doest the "WP_EN_(P)PC_TXT.tr3 2006-Oct-13 20:24:21" include? I see that some articles added even in May 2006 are not included :( ( example http://en.wikipedia.org/wiki/Magnolia_Bakery )

Thank you all!

Douglas said...

Much thanks for compiling/posting the .tr3 files. Unfortunately I'm having a problem with the Tomeraider text search (text box on lower-right) and finding any article beginning with the letter "b". All others work great. Any idea of the cause of the problem? A manual scroll will allow me to see the "b" articles.

Francisco said...

But these files are like a year old!!!! Is not there a more recent version?

Thanks.

David said...

Is there any way that the database can be updated? The main file is almost a year old.

Now that 4GB, 8GB cards have dropped in price, there are a lot of people who would enjoy having all of the articles (pictures too, if possible) available in the .tr3 file.

Thanks.

Paul said...

Its been 6 months without an update now. This is very disappointing. I only purchased TR3 to get Wikipedia. I'm feeling like I wasted $38.

I feel that Wikipedia should be updated at least once a quarter (because it changes so rapidly) and a range of sizes should be offered for those of us with large (4GB+) memory cards.

vertigo said...

+1 to having different versions for different people, including full-text and full-text with pictures versions. I use wikipedia so much and find it so incredibly useful that I would definitely buy a card large enough to store it if it were made available. Also, it really should be updated more often, at the very least twice annually, if not quarterly. Finally, I also noticed the bug with searching the b's, a problem which was reported almost 4 months ago. As another poster said, my only reason for purchasing TomeRaider (I haven't yet) is for Wikipedia, but I am not going to spend/waste the money for a product that is so limited (lack of full-pictures version), out of date, and bugged, not to mention the fact that it's been 4 months and the bug still has not been corrected. I might be able to deal with one of these issues, and be willing to spend the money despite it, but not all three.

vertigo said...

Also, back and forward buttons and a history of more than the last one or two items would be great. And I don't know if I'm missing something, but if you go into the Find screen, there's no way to start the search or even get back to the article, you have to completely exit out of the book. Finally, it keeps reverting back to taking up only half the width of the screen, and I have to open then close the typing box to make it take up the full screen. This may be due to the fact that I have a Tapwave Zodiac, so I view it in widescreen, which is the equivalent of landscape mode on a normal palm, and so I'm not sure anything could really be done about it.

Daithi said...

I'm waiting for a 2008 update to your wikipedia tr3 file before i purchase tomeraider. As is anyone i know. Its a deal breaker that your version of wikipedia is very old now.

djpao said...

tengo casi intala en mi palm os


www.palmos.net.tf

mitchelln said...

I've just paid to download the March 2008 version from Tomeraider.

It seem to me to be an increment of on Erik Zachte's free version.

A very large proportion of the articles are identical to Erick's even though the Wikipedia articles from around March 2008 are substantially different.

So is the 2008 version a true new snapshot of Wikipedia or an increment of on Erik's (i.e.only new articles added)?
You should make this clear as it will disappoint people like me.

Surinder Rinku said...

When will we have the 3.7 Gb version of wiki for palm users? We see it listed for windows but the site says that the palm version would be out soon.

mitchelln said...

Unfortunately it all seems to have gone quiet at Yadabyte. My support emails have gone unanswered as well :(

Surinder Rinku said...

Mine too

buy wow gold said...

When Wow Gold wolf finally found the wow gold cheap hole in the chimney he crawled cheap wow gold down and KERSPLASH right into that kettle of water and that was cheapest wow gold the end of his troubles with the big bad wolf.
game4power.
The next day the Buy Wow Goldlittle pig invited hisbuy gold wow mother over . She said "You see it is just as mygamegoldI told you. The way to get along in the world is to do world of warcraft gold things as well as you can." Fortunately for that little pig, he buy cheap wow gold learned that lesson. And he just k4gold lived happily ever after!.

xiaoxu said...

Articles are meaningful, and your blog is nice!
polo jacket
polo shirt
ralp lauren jacket
cheap polo shirts
spyder jackets
discount polo shirts
ralph lauren shirt
columbia jacket
north face jacket
cheap ralph lauren shirts
women's columbia jackets
polo t shirts
polo men's shirt
ralph lauren men's shirt
polo mens shirt
cheap polo jackets
ralph lauren mens shirt
wholesale polo jacket
ralp lauren polo shirts
short sleeve polo shirt
men polo shirt
lacoste polo shirts
wholesale polo shirts
men's polo shirts
cheap polo ralph lauren
cheap polo t-shirts
cheap polo clothes
custom polo shirts
discount north face jackets
ladies spyder jacket
tennis rackets
tennis racket
tennis racquet
tennis racquets
wilson tennis rackets
prince tennis rackets
head tennis rackets
babolat tennis rackets
best tennis racket
cheap tennis rackets
wilson tennis racquets
head tennis racquets
babolat tennis racquets
cheap tennis racket

qingchengzhilian said...

Your blog is very good, it's the best blog I've ever seen, thank you!
By the way, do you like polo shirts, which are very chic, especially the polo t shirts, I love them very much. I also like playing tennis rackets, it can keep healthy, what do you like to do? I'd like to introduce myself as the outlet of polo t shirts women, polo t shirts on sale, and polo t shirts for women. These products are our masterpieces, such as polo shirts on sale, polo shirts men, men's polo shirt, men polo shirt, mens polo shirts, mens polo shirt, besides we also sell cheap polo shirts, discount polo shirts, men's polo shirts, women's polo shirts. We are also the outlet of, cheap tennis racket, discount tennis racket, we recommend prince tennis racquet, head tennis rackets, wilson tennis racket, babolat tennis racquet. And it is our great pleasure that you come to our store online!

Opal said...

http://cellphones.blog.sohu.com
http://dressweddingstores.wordpress.com
http://discount-cell-phones.sosblog.com
http://wedding-dress-online.blog.anous.fr
http://wedding.blogge.rs
http://cellphones.blog131.fc2.com

icemi said...

Inspiron 1100 Inspiron 1150 p90x Inspiron 1210 Inspiron 1300 Inspiron 1318 Inspiron 1420 inspiron 1425 Inspiron 1501 Inspiron 1520 Inspiron 1521 Inspiron 1525 Inspiron 1526 Inspiron 1720 Inspiron 1721 INSPIRON 2600 INSPIRON 2650 Inspiron 4000 Inspiron 4100 Inspiron 4150 Inspiron 500m Inspiron 5100 Inspiron 510m Inspiron 5150 Inspiron 5160 Inspiron 6000 Inspiron 600m Inspiron 630m

icemi said...

wedding dress wedding dress discount wedding dress , Learn French , Learn English , Learn Chinese ,Learn Arabic ,Learn Italian , Learn Korean , Learn Portuguese , dvd boxset .wedding dress ,cheapest wedding dress ,cheapest wedding dresses ! Dell GD761 battery Dell GK479 battery Dell GW240 battery Dell PC764 battery Dell 75UYF battery Dell 8N544 battery Dell NF343 battery , ghd ghd straighteners Dell D5318 battery Dell Y9943 battery Dell RN873 battery Dell G5260 battery 312-0660

icemi said...

Inspiron XPS Gen 2 . Laptop Batteries , Batteries , hip hop abs ,hip hop abs , hip hop abs coupon , hip hop abs dvd , miami vice dvd Insanity , insanity popular ,Insanity , Insanity Workout , The Beatles ,The Beatles DVD ,The Beatles , miami vice The Beatles DVDs ,The Beatles Stereo CD DVD Box set ,The Beatles Mono CD Box Set ,The Beatles Postcard Box Set ,Rosetta Stone , p90x , rosetta stone spanish , Rosetta Stone OEM . Buy OEM Rosetta Stone , Learn Spanish , Learn Russian . Learn-Japanese , Learn German

aiya said...

Obama Is Lying<1>Office 2010When was the last time the MSM took a Republican's side in a fight over credibility with a Democratic opponent? Well, it has been a while. Microsoft Office 2010
However, conservatives have little to grumble about in the recent face-off between Barack Obama and John McCain over McCain's statement that Microsoft wordtroops might have to remain for "100 years" in Iraq "as long as Americans are not being injured or harmed or wounded or killed" after Office 2007Microsoft OfficeMicrosoft Office 2007 Office 2007 keyOffice 2007 downloadOutlook 2010Windows 7Microsoft outlookMicrosoft outlook 2010

laptop battery said...

I must say this is a great article i enjoyed reading it keep the good work.
Dell Inspiron 1150 battery
Dell Inspiron 1200 battery
Dell Inspiron 1300 battery
Dell Inspiron 1501 battery
Dell Inspiron 1520 battery
Dell Inspiron 1521 battery
Dell Inspiron 1525 battery
Dell Inspiron 1526 battery
Dell Inspiron 1720 battery
Dell Inspiron 1721 battery
Dell Inspiron 2100 battery
Dell Inspiron 2200 battery

andre12323 said...

christian louboutin shoeschristian louboutin shoes
christian louboutin bootschristian louboutin boots
christian louboutin sandalschristian louboutin sandals
christian louboutin slingbackchristian louboutin slingback
christian louboutin sneakerschristian louboutin sneakers
christian louboutin wedgeschristian louboutin wedges
christian louboutin weddingchristian louboutin wedding
timberland bootstimberland boots
asics shoesasics shoes
asics running shoesasics running shoes
dsquared jeans mendsquared jeans men
dsquared shoes 2011dsquared shoes 2011
karen millen dresseskaren millen dresses
marque t shirtmarque t shirt

abercrombiefitch said...

Both sides also collectively released a 3 festivities to commemorate the tenth anniversary of cooperation
Nike Air Max Shoes
Nike Air Max 2011
Nike Air Max
Nike Air Max 2009
Nike Air Max 95
Nike Air Max 91
Nike Air Max 87
Nike Air Max 180
Nike Air Max Griffey Max 1
Nike Air Max 90
Nike Air Max 1
Nike Air Max Wildwood Supreme
Nike Air Max Turbulence
Nike Air Max Skyline
Nike Air Max Goadome
Nike Air Max Fitsole
Nike Air Max Zenyth
Nike Air Max Boots
Nike Air Max Zoom Kobe
Nike Air Max Tn
Nike Air Max LTD
Nike Air Max Presto
Nike Air Max BW
Nike Air Max 24 7
Nike Air Max 2010
Nike Air Max 2011
Abercrombie and Fitch London
Abercrombie & Fitch Clothes
Vibram Shoes
Cheap Air Max
Nike Air Max Shoes
I saw peach falling from the window in your house. Walking really happy, to ensure that all of the uncomfortable into simple

silence. I'm the only person who heard one's heart beat.

jelish said...

Dear friends,Cheap Sale Louboutin online.All shoes elegant shoes is one of masterpiece from Christian Louboutin Platforms. When you buy yourself a pair of Christian Louboutin Thong Sandals
shoes you allow yourself to benefit from the vast experience and expertise that this brand has collected over the years.Christian Louboutin Platform Sandals
shoes is the personification of women,is their direct orgin of racial pride.Christian Louboutin Shoes
shoes is the personification of women,is their direct orgin of racial pride.andChristian Louboutin Mensis a very distinctive design, its design reflects its style. You put on it, that means you have its style.Welcome to our Louboutin Shoes Sale .

Nora said...

Wow! What can I say?Truely a nice article and thanks for your great work. By the way,welcome to our websites. You most definitely have made this article into something special. At the same time,Welcome to look at my website ghd uk and hope we can become good friends, and exchange and to help each other! Thanks.Best Ghd Hair Straightener
What's more, you can visit Ghd Australia to browse New Hair Straighteners
You may also like Ghd Australia and Ghd Hair Straightener
http://www.ghd-chi-australia.com

xiaofen said...

You wish for getting to create people nowadays worried about women? can you need a awesome coloring as women? We are Louboutin 2011store. we are able to provide you using a broad wide variety of Sale Louboutin. For example:Christian Louboutin Slingbacks,Christian Louboutin Peep Toe,Christian Louboutin Evenings,Christian Louboutin Pumps. andChristian Louboutin Mensis a very distinctive design, its design reflects its style. You put on it, that means you have its style.You put on it, that means you have its style.They are astonishingly psychological color. Please do not pass up an superb chance.
http://www.sale-louboutin-shoes.us

xiaofen said...

Christian Louboutin Outlet Online shoe store is up for many years.A man who wants to play its expertise, it must fit the social environment needs. If you need from the social environment, their expertise will lose value. Therefore, we have according to community needs, determine their own actions, better to show themselves. Christian Louboutin Outlet Online shoes wear can make you look more beautiful, more attractive feet.

LauraStarBene said...

Nice post! Thanks for sharing!
Comprare Xenical

baele said...

So how is the Nike vapor soccer shoes changed? Visually. the new Vapor football boots have undergone the same new paint work as the Nike Mercurial Superfly boots and now feature the updated asymmetric, Nike soccer cleats fluorescent.but now it's time to take a look at the boot Nike mercurial vapor . - the original Nike Speed boot!

Happy Baby Peplo said...

We are dedicated to delivering the most recent and greatest high quality Louboutin Heels along with other artist at Christian louboutin Store.With this broad variety of Christian louboutin Heels and the beautiful Moncler Outlet and Moncler Outlet Online at our Moncler Online Shop. now gets the ladies' favorite. New Best Hair Straightener from our finest locks Straightener on the Chi Hair Straightene anything you have to produce Babyliss Hair Straightener that great bohemian style. Ghd Australia and ghd hair.

Olivia said...

Your Escort Agency offers exclusive and most beautiful London escort girls of various nationalities.
Your Escort Agency

Rita said...

Bestescort4U agency provids best London escorts companionship in the UK.
London escorts

Escorts London said...

Hot - Collection is a honest and confidential London escort agency which provides genuine London escorts girls for gentlemen of taste.
London escorts

Unknown said...

Nice information,Escort ankara
many thanks to the author.indirmeden izle
It is incomprehensible to me nowgünlük kiralık ev
, but in general,beylikdüzü günlük kiralık
the usefulness and significance is overwhelming.Ankara escort
Thanks again and good luck!
escort ankara
became the first designer in Wimbledon's 133-year history to create official uniforms for the tournamentescort izmir
As part of this year's event, which starts next week.
will introduces the first ...film izle
determinationEscort ankara
to maintain and enhance the values for which our two brands are famous throughout the world.escort ankara bayan
The rugby ralph lauren brand brings to Wimbledon the look of timeless elegance,escort bayan ankara
drawing on our rich history and traditionsEscort ankara
expert and i like your blog and the information you have
mentioned in this post about the Google tools is really great!
escort bayan
escort
escort istanbul
Bayan Escort
escort bayan ankara
taksim günlük kiralık ev
escort Kayseri
escort bayan ankara
escort ankara bayan
Escort Bayan Ankara
Ankara Escort,
Thanks for sharing. Very impressive

Bob_Alfredo said...

Amazing post, I like it. It was quite interesting nice work. I appreciate the information you provided is excellent post. Thank you for sharing you do.

Conversion Analysis Report

logo bench said...

Hi – I am so delighted I found your blog, I really found you by accident, while I was researching on Digg for something else. Nonetheless I am here now and would just like to thanks for a fantastic post and an all round interesting blog (I also love the theme/design).

Create a Business Logo

Admin said...

Thank you for your post, I look for such article along time,today i find it finally.this post give me lots of advise it is very useful for me.

Buy A Ready-Made Logo

justin albert said...

Great article, it was very helpful! I just started in this and I'm getting to know it better! Cheers, keep up the good work!

Blackberry App Developer

Ad min said...

This is a great inspiring article. I am pretty much pleased with your good work.You put really very helpful information.
Photo App

saranya zinavo said...

Thank you for your sharing . This is a very good and wonderful blog . It combines humor with unique and innovative style , sharing a lot of meaningful knowledge and help . These are a great help to many readers .
sunglasses for women