The final stage in publishing an ebook is formatting it. This used to be a pretty simple deal. Essentially you converted your file to HTML added a couple of tweaks and the cover art, all zipped into a single file.
Amazon's Kindle is no longer that simple. Amazon now insists that book submitters use the .ncx file format to submit the table of contents. Ncx is an XHTML format for tables of contents, so it's sorta HTML, but not quite.
This has the advantage that it allows things like a hyperlinked table of contents for the talking book version. It has the disadvantage of being so arcane there's little information on how to do it available.
Fortunately someone stepped up to the challenge. April K. Hamilton, author of "The Indie Author Guide to Publishing" (good book) has come out with "The Indie Author Guide For Publishing For The Kindle With Amazon's Digital Text Platform, Mobipocket Creator And MS Word 2003 Or Higher." In it she walks you through the steps involved in taking your book from a text file to a ready-to-submit zip file.
Hamilton is owed a vote of thanks by everyone in the e-authoring community for untangling this tangled tale. Be warned: The process still isn't easy, but at least you can more-or-less understand it.
Wednesday, July 13, 2011
Tuesday, July 12, 2011
"Shift Happens" is almost out
"Shift Happens" my new ebook on the revolution in publishing is at the formatter and should be published in two or three days.
Another long slog done.
I will say the process of publishing an e-book is a lot easier, and a lot faster, than a conventional paper book. Now that royalties on ebooks are hitting 70 percent from Amazon I have to wonder how much longer paper books will remain the preferred way to publish popular fiction. The advantages for both author and reader just keep piling up.
--RC
Another long slog done.
I will say the process of publishing an e-book is a lot easier, and a lot faster, than a conventional paper book. Now that royalties on ebooks are hitting 70 percent from Amazon I have to wonder how much longer paper books will remain the preferred way to publish popular fiction. The advantages for both author and reader just keep piling up.
--RC
Sunday, July 10, 2011
Scanning -- again
Still the scanning saga continues.
I finally got the document scanned and OCRed and started on the corrections. I quickly discovered I'd been two optimistic when I said that one error in 200 was acceptable. It's not really.
In an 18,000 word story that amounts to several thousand errors and some of them are things like substituting an "l" for an "I" which are hard to spot.
What's worse, several sections of the story didn't scan so I've got holes I've got to refill by retyping several pages at a stretch.
Now I am not a proofreader, I'm a writer. I don't have the kind of detail-oriented mind it takes to ferret errors like this and fix them.
And then there's the other problem.
This one I can't blame on the OCR software. It seems that the magazine ended each line with a hard line break. Ducky, except that the story was set two columns to a page so to get the copy prepared I've got to go through and take out all those hard line breaks.
I won't bore you with a long, technical explanation of why that's a problem, except to say that very few word processors allow you to find and replace hard line breaks the way you can other characters. To do it you need to delve into regular expressions -- which are their own brand of magic -- and the regular expressions in LibreOffice are unusually arcane.
What it comes down to is I've got to go through the story and reinsert the paragraph breaks that were left after I got rid of the hard line breaks. By hand.
As a result I've got a headache and I'm still not done with this.
I've come to several conclusions here. The first is that I need better OCR software. FreeOCR just isn't accurate enough for long documents. So I'm getting Omnipage from Nuance, which is $150 but comes highly recommended. The second conclusion is I may need more than that if I'm going to scan in all my stories for my collection "Cooks Book".
I'll try OCRing with Omnipage, but if that doesn't work I'll either have to get a better scanner or farm the job out to a service bureau.
Which reminds me of something John W. Campbell told me once: "Always use the right tool for the job. The right tool to fix a television set is a television repairman."
I finally got the document scanned and OCRed and started on the corrections. I quickly discovered I'd been two optimistic when I said that one error in 200 was acceptable. It's not really.
In an 18,000 word story that amounts to several thousand errors and some of them are things like substituting an "l" for an "I" which are hard to spot.
What's worse, several sections of the story didn't scan so I've got holes I've got to refill by retyping several pages at a stretch.
Now I am not a proofreader, I'm a writer. I don't have the kind of detail-oriented mind it takes to ferret errors like this and fix them.
And then there's the other problem.
This one I can't blame on the OCR software. It seems that the magazine ended each line with a hard line break. Ducky, except that the story was set two columns to a page so to get the copy prepared I've got to go through and take out all those hard line breaks.
I won't bore you with a long, technical explanation of why that's a problem, except to say that very few word processors allow you to find and replace hard line breaks the way you can other characters. To do it you need to delve into regular expressions -- which are their own brand of magic -- and the regular expressions in LibreOffice are unusually arcane.
What it comes down to is I've got to go through the story and reinsert the paragraph breaks that were left after I got rid of the hard line breaks. By hand.
As a result I've got a headache and I'm still not done with this.
I've come to several conclusions here. The first is that I need better OCR software. FreeOCR just isn't accurate enough for long documents. So I'm getting Omnipage from Nuance, which is $150 but comes highly recommended. The second conclusion is I may need more than that if I'm going to scan in all my stories for my collection "Cooks Book".
I'll try OCRing with Omnipage, but if that doesn't work I'll either have to get a better scanner or farm the job out to a service bureau.
Which reminds me of something John W. Campbell told me once: "Always use the right tool for the job. The right tool to fix a television set is a television repairman."
More on the world changing
Ran across a fascinating post by Robin Sullivan at
http://publishingperspectives.com/2011/06/self-published-ebook-authors-earn-living/
dealing with the changes in epublishing. Sullivan (whose husband is Michael J. Sullivan, a fantasy author) keeps records of her husband's sales and also tracks the Writers Cafe forum on the Kindle Boards. And she documented the change.
Basically it happened a lot faster and more sharply than I thought. According to Sullivan, the change started with an increase in sales in November-December in 2010 and accelerated from there. Michael Sullivan, for example, went from sales of about $1,500 a month for the self-published and ebook versions of his novels to making just over $100,000 in the first five months in 2011. Almost all the increase came in ebooks.
In her blog post Sullivan then analyzes the reports from Writer's Cafe. Of the authors reporting, the number of writers selling more than 800 copies a month of their books went from about 30 a month to around 80 a month in the same period. By the end of the period, the top ten writers were making between $3900 a month and $16,000 a month from their ebooks.
To which I can only say: "Write on dudes and dudettes!"
http://publishingperspectives.com/2011/06/self-published-ebook-authors-earn-living/
dealing with the changes in epublishing. Sullivan (whose husband is Michael J. Sullivan, a fantasy author) keeps records of her husband's sales and also tracks the Writers Cafe forum on the Kindle Boards. And she documented the change.
Basically it happened a lot faster and more sharply than I thought. According to Sullivan, the change started with an increase in sales in November-December in 2010 and accelerated from there. Michael Sullivan, for example, went from sales of about $1,500 a month for the self-published and ebook versions of his novels to making just over $100,000 in the first five months in 2011. Almost all the increase came in ebooks.
In her blog post Sullivan then analyzes the reports from Writer's Cafe. Of the authors reporting, the number of writers selling more than 800 copies a month of their books went from about 30 a month to around 80 a month in the same period. By the end of the period, the top ten writers were making between $3900 a month and $16,000 a month from their ebooks.
To which I can only say: "Write on dudes and dudettes!"
Thursday, July 7, 2011
Roots of Revolution, Part 2: The Day The World Changed
Americans love fixed dates for any important event. Thus, we celebrate the 4th of July to mark American independence and we mourn Sept. 11 as the beginning of the war on terror.
Of course most such dates don't mark when the real event happened. Both the American Revolution and the War on Terror started considerably before those dates, but we like the comfort of having a nice solid date we can quote like a mantra.
The change that's taking place in publishing has a special date as well. January 20, 2010. Like the others, the tidal wave didn't start then, but it is significant. In future years I wouldn't be surprised if authors get together to raise their glasses and party on that day.
(Not so much because most authors will remember the date, but because authors love an excuse to slack off and party.)
What's so special about January 20, 2010? That's the day that Amazon kickstarted the epublishing revolution by announcing they would be raising the royalties on their ebooks to 70 percent of list prices. (Amazon actually raised rates on Jun 30, so you can celebrate that date too.) That makes it a convenient date to mark as the day the Revolution began.
The higher royalties were actually the second step in the events starting the revolution. The first one was the ebook readers took off. Today something like 12-15 percent of all American readers own an ebook reader and Amazon sells more ebooks than it does conventional books. Between them, those facts set off the explosion in publishing.
There is a third factor leading to the revolution as well. Ebook publishers do an absolute minimum of gatekeeping. If you write an ebook, Amazon or Smashwords or whoever is just about sure to publish it, no matter what the subject. (I will admit I've had a little trouble selling the concepts for The Serial Killers' Handbook and The Official Hannibal Lechter Fan Club Guide And Recipe Book, but those are about the only limits.)
So, anyone gets to publish anything they want, charge between $2.99 and $9.99 for it and collect a royalty of 70 percent of the price. That's a minimum of $2.10 per book.
Both buyers and sellers were energized by the changes. Buyers responded by buying more ebooks readers than even the most sanguine marketers imagined -- and they're still buying them. Sellers started cranking out books so the buyers would have a large choice of reading material at very low prices. The cycle rapidly became self-perpetuating and it shows no sign of slowing down.
We'll leave the quality of the new books for another post. Here we'll simply observe that there is a huge amount of dreck being published. Illiterate dreck, mostly. However there are also some gems that rival the best printed books being published (never mind the stuff that makes the best seller lists)
So the next time January 20 rolls around, buy a writer a drink and raise your glasses to the Revolution.
Of course most such dates don't mark when the real event happened. Both the American Revolution and the War on Terror started considerably before those dates, but we like the comfort of having a nice solid date we can quote like a mantra.
The change that's taking place in publishing has a special date as well. January 20, 2010. Like the others, the tidal wave didn't start then, but it is significant. In future years I wouldn't be surprised if authors get together to raise their glasses and party on that day.
(Not so much because most authors will remember the date, but because authors love an excuse to slack off and party.)
What's so special about January 20, 2010? That's the day that Amazon kickstarted the epublishing revolution by announcing they would be raising the royalties on their ebooks to 70 percent of list prices. (Amazon actually raised rates on Jun 30, so you can celebrate that date too.) That makes it a convenient date to mark as the day the Revolution began.
The higher royalties were actually the second step in the events starting the revolution. The first one was the ebook readers took off. Today something like 12-15 percent of all American readers own an ebook reader and Amazon sells more ebooks than it does conventional books. Between them, those facts set off the explosion in publishing.
There is a third factor leading to the revolution as well. Ebook publishers do an absolute minimum of gatekeeping. If you write an ebook, Amazon or Smashwords or whoever is just about sure to publish it, no matter what the subject. (I will admit I've had a little trouble selling the concepts for The Serial Killers' Handbook and The Official Hannibal Lechter Fan Club Guide And Recipe Book, but those are about the only limits.)
So, anyone gets to publish anything they want, charge between $2.99 and $9.99 for it and collect a royalty of 70 percent of the price. That's a minimum of $2.10 per book.
Both buyers and sellers were energized by the changes. Buyers responded by buying more ebooks readers than even the most sanguine marketers imagined -- and they're still buying them. Sellers started cranking out books so the buyers would have a large choice of reading material at very low prices. The cycle rapidly became self-perpetuating and it shows no sign of slowing down.
We'll leave the quality of the new books for another post. Here we'll simply observe that there is a huge amount of dreck being published. Illiterate dreck, mostly. However there are also some gems that rival the best printed books being published (never mind the stuff that makes the best seller lists)
So the next time January 20 rolls around, buy a writer a drink and raise your glasses to the Revolution.
Wednesday, July 6, 2011
Scanning: The saga continues
When last we left our hero he was trying to scan in one of his stories from a science fiction magazine so he'd have a text file to edit to reprint the story. You know, the job that people always tell you is "easy".
In a pig's eye, said the little bird.
The scanning itself went fine. I've been scanning contracts and such for long enough I pretty much know the drill. The fun began when I tried to put the .pdf file from the scan through the OCR software to get a text file.
The first problem was I couldn't get the program to start. Every time I gave it a file name to upload the text copy to the program rejected it a message saying there was an error in the path name. Finally I called HP tech support. It cost me $20 because the printer was out of warranty, and a lot of time on the phone, but the tech was able to locate the problem. It turned out I couldn't enter a path name without hitting the "browse" button. Talk about counter-intuitive and no hint in the documentation.
Okay, problem solved. Now to let the OCR software create the text file. Tell it to go and it starts scanning -- and then stops halfway into the first page. The system hangs, eventually crashes and does something bad to the system that requires a power-off re-start to fix.
Rinse and repeat a couple of times.
The obvious diagnosis is that the software stubbed its toe on something, wandered off into the weeds and did something funky somewhere where it shouldn't. But what do I know? So another call to HP tech support. This time t hey don't charge me $20, but it takes an inordinate amount of time messing with settings and such. Finally in the course of this I repeat (for the second or third time) casually to the tech that this is a really big file.
How big? he asks not so casually. 40 pages or so, I tell him. Aha! A quick check of task manager reveals that the file is about 20 MB. Way too big for the program to handle. After a little messing the tech determines that there's no way the software will read a file that size. So its either re-scan the file in smaller chunks (ugh!) or find other software that can handle it (less ugh, but expensive).
I decide to see what I can find in the way of new software. After looking, I come across a recommendation for an Open Source program called "FreeOCR", which is, guess what?, free.
What the heck. I'm on deadline and I need something NOW. So I download FreeOCR and try it.
And it works. Not perfectly. There are a couple of annoying little details, like having to select each column on the page separately to input, but it's fast and it will read a file that size without even breathing hard. (The trick is that FreeOCR operates on a page at a time, no matter how large the file is. So instead of choking on 20 MB of stuff, it takes it in smaller bites.) True, it doesn't do as good a job at character recognition, missing maybe one character in 200, but even at 40 pages that's good enough for me.
So a 'simple' job of scanning ended up taking two days of clock time because scanning isn't so simple at all. A few years ago I was talking to Eric Flint, who is head of the Baen Free Library. The Library is a program to provide free Baen e-books online. (Usually the first book in a series, which hooks you nicely and then they sell you the other books.) He was talking about how difficult it was to get books up for the library, especially the ones that were printed before delivering books as word processor files became popular.
Someone suggested that Eric use volunteers to scan in the books. Eric reacted negatively -- overly so, I thought.
However after this week's experiences, I think I owe Eric an apology.
--RC
In a pig's eye, said the little bird.
The scanning itself went fine. I've been scanning contracts and such for long enough I pretty much know the drill. The fun began when I tried to put the .pdf file from the scan through the OCR software to get a text file.
The first problem was I couldn't get the program to start. Every time I gave it a file name to upload the text copy to the program rejected it a message saying there was an error in the path name. Finally I called HP tech support. It cost me $20 because the printer was out of warranty, and a lot of time on the phone, but the tech was able to locate the problem. It turned out I couldn't enter a path name without hitting the "browse" button. Talk about counter-intuitive and no hint in the documentation.
Okay, problem solved. Now to let the OCR software create the text file. Tell it to go and it starts scanning -- and then stops halfway into the first page. The system hangs, eventually crashes and does something bad to the system that requires a power-off re-start to fix.
Rinse and repeat a couple of times.
The obvious diagnosis is that the software stubbed its toe on something, wandered off into the weeds and did something funky somewhere where it shouldn't. But what do I know? So another call to HP tech support. This time t hey don't charge me $20, but it takes an inordinate amount of time messing with settings and such. Finally in the course of this I repeat (for the second or third time) casually to the tech that this is a really big file.
How big? he asks not so casually. 40 pages or so, I tell him. Aha! A quick check of task manager reveals that the file is about 20 MB. Way too big for the program to handle. After a little messing the tech determines that there's no way the software will read a file that size. So its either re-scan the file in smaller chunks (ugh!) or find other software that can handle it (less ugh, but expensive).
I decide to see what I can find in the way of new software. After looking, I come across a recommendation for an Open Source program called "FreeOCR", which is, guess what?, free.
What the heck. I'm on deadline and I need something NOW. So I download FreeOCR and try it.
And it works. Not perfectly. There are a couple of annoying little details, like having to select each column on the page separately to input, but it's fast and it will read a file that size without even breathing hard. (The trick is that FreeOCR operates on a page at a time, no matter how large the file is. So instead of choking on 20 MB of stuff, it takes it in smaller bites.) True, it doesn't do as good a job at character recognition, missing maybe one character in 200, but even at 40 pages that's good enough for me.
So a 'simple' job of scanning ended up taking two days of clock time because scanning isn't so simple at all. A few years ago I was talking to Eric Flint, who is head of the Baen Free Library. The Library is a program to provide free Baen e-books online. (Usually the first book in a series, which hooks you nicely and then they sell you the other books.) He was talking about how difficult it was to get books up for the library, especially the ones that were printed before delivering books as word processor files became popular.
Someone suggested that Eric use volunteers to scan in the books. Eric reacted negatively -- overly so, I thought.
However after this week's experiences, I think I owe Eric an apology.
--RC
Subscribe to:
Posts (Atom)