Losin’ Myself in Lossless

9 September 2009

Predictably, I’ve decided that, in contrary to what I said in my last post, I’m going fully lossless. That means that all CDs will be reripped as Apple Lossless. The journey will end.

I’m going to start with those CDs that have hidden tracks. As I’ve ripped my collection, I’ve been alert to unusually long final tracks, which often denote a hidden track. I don’t rip these in iTunes. I open the CD in the Finder and drag the final track to the desktop. I then open it in QuickTime Player, find and chop out the hidden track, save that as an AIFF and save the shortened original as an AIFF. I then drag these into iTunes and rip as Apple Lossless. I used to then rip those to 256Kbps AAC and store the Lossless originals in a folder archive, out of iTunes.

So that’s the starting point. Rip the CD minus the two last tracks, drag in the Lossless tracks, done.

Well, almost. They need to be “double-tagged“. I’ve started trialling Meta X. It’s not perfect. For a start, it wants to classify a Lossless track as a movie, a TV show or a music video. It thinks it’s video. I run the tracks through Lostify first, specifying a kind of  Normal (Audio). Meta X then respects this. Meta X allows me to write two tags that Lostify can’t: audio Content Rating and Purchase Date. This latter is a little flaky. If I enter 2005-05-29, it’s converted to Zulu notation and given a time as well. The date is always a day later, so the above example will appear something like 30 May 2005 6:00PM in the Summary tab of the Get Info dialog for a single track. I need to understand how Zulu time works.

I’ve got a database listing every single CD I’ve bought, with the date, supplier and cost, so I have the purchase data. I’m hoping a later revision will also present the Purchased By tag so I can finish the job with my name.

What about the other end of the equation, the real bottleneck, the iPod? I had an inspiration. My two-year-old 160Gb Classic would not be worth too much now, especially after tomorrow’s iPod event, so I’m better off keeping it. The solution is simple: buy an additional Classic and run two Classics to hold the library. I would have put off getting an additional Classic until next year but the free space is being consumed at an alarming rate and I’ll run out in about a month. Two Classics, especially if the new one tomorrow is 160Gb or greater, is the solution until that fabled 500Gb iPod Touch becomes reality.

I tried to work out how much space to expect Lossless files to take up, but the math is difficult. I believe Lossless compresses at different rates depending on the audio pattern. For example, the last track of Massive Attack’s 100th Window, Antistar, is bigger than the hidden track, LP4, even though LP4 is much longer. LP4 is little more than 11:23 of static, which is super-efficient to compress. It will take months, probably a year, given all my projects, before I could rerip everything, so space will not be an immediate concern.

So that’s my journey. Light at the end of the tunnel at last. Enjoyable all the way.


Managing the iTunes Plus Upgrade Process

3 February 2009

If you haven’t modified any of the tags for the music you previously bought from the iTunes Store, then the tags for the Plus replacements should match. The Plus tracks will have a new Date Added but otherwise will appear the same. The average user will be unaware of the change.

Fiddlers like myself will get into trouble if they simply do an upgrade as the tags won’t match. I always make sure my purchased music has a release date, that the album name and track number is correct (free song-of-the-week titles are usually wrong). I complete the tagging of music videos (usually they have a name and little else). I may replace the album art with one of my superior scans. You get the idea. Here are my recommendations for upgrading, all of which I followed in my own recent upgrade.

Download on a Different Computer or Library

My library is on my desktop machine. I downloaded on my laptop, which I use as a workspace to tag music before I merge it with the main library. The laptop is authorised for my iTunes Store account as is the desktop. The songs to upgrade are tracked by the Store from its own records, not based on the presence of any tracks in the library you are working with, so you can download to a different computer, even if the original songs are not there.

Alternatively, if you don’t have a secondary computer to work with, you can create a new, separate library to download to. Quit iTunes, then relaunch while holding down the Option key (Mac) or Shift key (Windows). This will bring up a dialog where you can choose an existing library or create a new one. Create one on the desktop for ease of finding in a later step. Log into the iTunes Store, click the iTunes Plus link, buy what you want (you can select what you want to upgrade now–you’re not forced to upgrade everything) and download it.

Merging with the Main Library

In this step you’ll add the new files to the existing library for checking against the originals.

If you’re using the double-library approach, quit iTunes and relaunch while holding down Option or Shift. Choose the main library. Once iTunes has launched, create a new static playlist called iTunes Upgrade. Open the iTunes library folder on the desktop. Burrow down to the iTunes Music folder and drag that folder into the new iTunes Upgrade playlist. If you downloaded on another machine, get the files across by any convenient method and drag into the playlist. As soon as one track has finished copying, hold down the Command key (Mac) or Control key (Windows) and click the checkbox next to the name. This will uncheck all the tracks and prevent them from being synced to your iPod or Apple TV before you’ve finished editing them.

Editing the Tags

Now you’ve got two sets of files: the original 128kbps protected files and the new 256kbps Plus files. Sort the playlist by Album and find the first album in the main body of the library. Change the tags of the Plus song to match that of the Protected song if necessary.

Empty the trash. Click the Plus song and delete it. Don’t empty the trash. Right-click the remaining original protected song and select Show in Finder (Mac) or Show in Windows Explorer (Windows). This will open a window with the actual file location of the song. Drag the Plus file out of the trash and put it in the song folder. Throw the protected file in the trash and empty it.

Now you’ve broken the link to the song in iTunes because you’ve deleted the file but not the database record. We do this to preserve the Date Added value, because this cannot be changed unlike other values such as Date Last Played.

Click on the song and Get Info. iTunes will tell you it can’t find it and ask if you want to locate it. You do. Navigate to the Plus version in the original location and click the Open button. Now you’ll see the Get Info dialog for that song. iTunes will also update the record to reflect that the song is now 256kbps but other metadata such as Last Played, Play Count, Rating and of course, Date Added are unchanged.

Special Considerations

This is the main procedure. You may find that the original tracks are no longer available and you may be offered an alternative, or (theoretically) they will be ignored in the upgrade process. For more on this, refer to my earlier post.

Be careful with the Finder/Explorer hack, especially the step where you choose the “lost” file. If you choose the wrong one you’ll change the record in iTunes and you’ll have a duplicate on your hands. Fixing it is messy. You would have to select the two duplicate records and delete them, which will put the file in the trash. Drag it back into iTunes and you’ll recover it to the original album, but you’ll lose all that lovely metadata for both the original song and the one you were trying to map. You’ll have to also drag the song you were trying to map to into iTunes.

Summary

I’ll admit that it’s a bit of work and if you have bought an awful lot of songs it probably isn’t worth it, but for perfectionists like myself who haven’t bought much, I think it’s a good idea from the perspective of maintaining valuable metadata.


Uses of the iPhone for Photo Management

20 October 2008

I don’t often talk about photos but have been experimenting with a use of the iPhone for photo management. I have a nice camera that takes good photos, but it doesn’t have GPS. When I was at Sculpture By the Sea yesterday, I began each shoot of a particular work with a photo from the iPhone. The purpose of this photo was to record two pieces of information: the GPS coordinates and the number marker so that I could look up that work in the catalogue for tagging the photo in iPhoto. I wanted to avoid this marker in any photo I took with the camera but still needed to know what it was. Here are the two photos:

“On the Beach” (Tim Kyle) (iPhone Version)

“On the Beach” (Tim Kyle) (iPhone Version) (Click to enlarge)

“On the Beach” (Tim Kyle) (Camera Version)

“On the Beach” (Tim Kyle) (Camera Version) (Click to enlarge)

I didn’t bother with aesthetics for the iPhone photo such as composition, as it was performing a strictly documentary role. As a result, all of them looked awful except for this one, which was passable. I found it easy to pull the iPhone out for the reference shot, partly because I keep mine in a holster, and partly because I took about 10 photos of each piece, so I wasn’t handling both cameras all the time. I can see that this won’t always work, but it’s a way to add GPS data to your photos if you don’t have one built in. The camera in the iPhone is unsophisticated but I find it great for two purposes. Firstly, quick and dirty recording of data, such as the above, and things I see such as DVDs I want to buy. Quality is of no concern with this usage. The other usage is aesthetic art, which is a challenge given the limitations, but no less worthwhile for it. If you can get an aesthetically pleasing photo with the iPhone, you’ve really achieved something.


Net Labels: Free Music for the Taking

16 October 2008

A net label is a website that offers free music. It is distinguished from a site that offers a random selection of tracks by these factors:

  • The music is organised into titles, analogous to singles, EPs, albums and compilations
  • Often the work of a single artist is the subject of a title
  • Artwork accompanies the title, often of high resolution and intended for printing, so that jewel cases can be created for the title if burned to CD.

The music is given away for free. There are a number of reasons for this. The artist doesn’t want to release commercially, they are a hobbyist, the free work is promotional, etc. This means it’s legally free and legal to give to others. Often a Creative Commons licence is employed.

Those raised on a diet of commercial music will ask if the music is any good. In my opinion, the music from net labels is often very good in terms of skilled technical execution and aesthetic appeal. Rarely do I feel that a track is amateur. The point of the net label is to treat an artist’s music with respect and thus the resemblance to a commercial label operation.

I like music I can chill out to, so I have focussed on net labels that provide this type of music. Here is a list of sites that I consider to be the best.

  • Alpine Chic: Swiss electronica at its best.
  • iD.EOLOGY: German electronica, dub and hip hop.
  • Mercedes-Benz Mixed Tape: Awesome ephemeral compilations released every six weeks. A marketing vehicle for Mercedes, promoting it as a lifestyle brand. Each compilation is a mix of electronica, pop, RNB and hip hop, sometimes featuring known artists, but mostly a platform to present up-and-comers. As each new compilation is released, the previous is deleted, so these are collectables.
  • Jahtari: Amazing blend of low-tech computer music and reggae and dub. It really works.
  • Lo-Kiwi: Electronica.
  • Petit Poulet Records: Electronica.

These sites vary in that they can be considered net labels for individual artists, in other words, their own label. They still present their music in titles, so I consider them net labels.

These sites are still good, but I don’t always like the music. That’s just my opinion of course. The music still has that skilled technical execution, so it’s still good.

  • Monotonik & Friends: Huge repository of electronica and glitch/bleep (scratchy-sounding music created with low-tech computers). The titles vary widely in style, thus I don’t like everything on the site.
  • Autoplate/Thinner: Sister sites that specialise in glitchy electronica.
  • Electrobel: Electronica, some glitchy.
  • Offaudio: Spanish site. Beatier, dancier electronica.
  • One: Electronica.

Tagging is the one area in which they fall down. The tags are incomplete and lack artwork. Artwork is supplied separately, of course, except in the rarest of situations, and can be reformatted for use as album artwork. The Mixed Tapes are the worst, because the album tag is different for every song and the compilation flag is not used. I like fixing these tags, however, and this, in combination with my dissemination of the music, is my contribution to their efforts.

To keep track of the various releases, I tag the Grouping field with the website and the release number. Often there will be a specific release number, such as iD049 (iD.EOLOGY). If none, I number from the earliest, starting with 01. A title may end up with a Grouping tag something like this: www.ideology.de (iD049). I then create a smart playlist that looks for all tracks with www.ideology.de in the Grouping field, and that’s my iD.EOLOGY playlist.

Net labels have serious works available to you for free. Use them well to greatly expand your music library.


“Double-Tagging” Your CD Audio Files

10 October 2008

iTunes Store audio files contain a number of tags that can’t be done in iTunes, so audio files ripped from CDs will lack these. I tag these myself in a process that I refer to as double-tagging. This is not necessary by any means but I like the sense of completion that I get from doing this. This technique only works on the Mac because of the software I use.

Open the files in the venerable Lostify. If you check the option to add a script to iTunes, then you can select a range of songs in iTunes, then select the Lostify… link in the Script menu.

I have based my selection of additional tags on what I have observed with iTunes Store files. The tags to add are Release Date, Kind, Copyright and Content Rating.

Release Date

The release date is something you will have to research. Luckily, most CDs will be covered on the internet. I use Wikipedia, Rate Your Music, official artist sites, record label sites and the iTunes Store itself. Bizarrely, the most unreliable sources for release dates are often the official artist sites and record labels. If you find more than one date, try to take the most common one.

A note on compilations and rereleases. Consider The Chemical BrothersBrotherhood. It’s a singles compilation, released on 2 September 2008. Instead of tagging individual songs with the year that they were originally released, I tag each with this release date. The thinking is that the title on which the songs appear was released in 2008, as a discrete unit, so that’s the date to go with. It has the added advantage of sorting properly in iTunes if you sort by Album By Year. If you have individual years for the songs, it will force the whole album to the front of the list, as iTunes interprets the earliest date that appears in the album as the album date.

It’s not so clear-cut with rereleases. I’ve got a 25th anniversary edition of Deep Purple’s Machine Head. It was released in March 1972. My edition is obviously 1997. As the whole album is essentially intact and contains no new material, I have tagged this as 1 March 1972.

That’s another thing: sometimes you will not get a complete date. If you get, for example, March 1972, then make the release date 1 March 1972. If you get 1972 only, then make it 1 July 1972.

Kind

This should be set to Normal (Audio), unless you are tagging an audiobook, in which case it will be Audiobook.

Copyright

Begin this string with the Recording Copyright symbol ℗ (activate the character palette by pressing Command-Option-T, then do a search for it and add it to your favorites for ready access), then the year and the owner of the sound recording (not the artwork; these are sometimes separate), all obtained from the rear of the CD, the disc itself, or at a pinch, the iTunes Store.

That makes a very satisfying completely tagged file. You can admire your handiwork in the General tab of the Get Info dialog (copyright) and the Release Date column, which you can add to any view:


(Click to Enlarge)

Content Rating

There are three options here, Inoffensive, Clean and Explicit. The differences between these are important.

Inoffensive is the default and most iTunes Store songs are tagged as this. It doesn’t appear in iTunes. It is not possible to tag a track as Inoffensive with Lostify due to an unhandled bug, so leave it blank for now.

Explicit is self explanatory. If your CD mentions any kind of warning, then use this. Good for filtering out music that you don’t want kids to hear.

Clean is often misunderstood. It doesn’t mean Inoffensive. It is to be specifically used to indicate that it is a version of an explicit song, altered to remove explicit material. Sometimes albums in the iTunes Store are presented as both explicit and clean versions, so you can buy either. This could also apply to audiobooks and podcasts if they are altered, cleaner versions. There is very little call for this option.

I hope there are people out there that are as passionate about double-tagging as I am!


iTunes 8 Subtleties

15 September 2008

As I was skimming through albums in Grid view, by Artist, it struck me that the grid art was always the first title in alphabetical sequence. I wondered if I could change this to another cover as in iPhoto, by pressing the spacebar when hovering over a cover. Being iTunes, this of course started playing the first song from the first album for that artist. However, I found that if you skim to the cover that you want to represent the artist, right-click and select Set Default Grid Artwork, this will have the desired effect:


There’s a new Description tag in the Video tab:


(Click to enlarge)

You can use this to tag either audio or video. Note that while you can enter a huge amount of characters in this field, analysis with Lostify reveals that this is the short description, and anything over 256 characters is truncated when written to the file. If you import the file into another iTunes library, the description will be truncated.


In the Options tab, you can set whether an audio file is Music or an Audiobook:


(Click to enlarge)

or if a video file is a Movie, TV Show or Music Video


(Click to enlarge)

These are contextual based on file type and the tag is written to the file, not just the database, which is what earlier iTunes versions did. This is a good thing when transferring files to other iTunes libraries. Note that all these and more (Ringtone, etc.) are taggable in Lostify.


Nice new tagging options, but I’m going to stick with Lostify, as it still can access more tags than iTunes 8.


Podcasters: Beware of the Evil that is .mov

2 May 2008

Podcasters may not be aware of why they should not be posting video podcasts in the .mov format. .mov is a software “wrapper” that contains a minimum of two components: video and audio. The components can be in different codecs. So even if you believe that you are doing the right thing by using H.264 and AAC (you are), there are implications in using the .mov wrapper that you should be aware of.

.mov cannot be tagged. Well, a number of tags can be assigned in iTunes (notable exception being album art) but this only writes the tags to the database, not the file. This means that as soon as the episode is moved out of iTunes, it loses all the tags. In the case of podcasts, this includes, most tragically, the podcast flag and the long description. The only “tag” remaining is the title name and the disc and track number (if set), and this is only stored in the form of the file name. When you bring those episodes back into iTunes, they appear in the Movies library as 01 Episode 1.mov, etc, with no other tags. All that hard work from your RSS feed is wasted and is not recoverable.

A podcastee may have archived past episodes and want to reconstitute them into iTunes, or, as I have done in the past, handed them on to others so that they don’t have to download the episodes themselves. This saves lots of bandwidth. In either case, the results will be disappointing.

The MPEG 4 file format (.m4v or .mp4) is a wonderland of tagging possibilities. Cali and Neal, of Geekbrief.tv, for example, have recently started using one of my favourite tools, Lostify, to tag their .m4v (H.264/AAC) files as TV Show so that, in addition to all the embedded podcast tagging that iTunes does when the file is downloaded, they can be found in both the Podcasts and TV Shows libraries. Copyright, explicit, short description, etc. can also be tagged.

So my appeal to podcasters is to be aware of this and not to use .mov. The software you are using to create your files might be able to generate .m4v files. iMovie 08 will do it. Personally, I use QuickTime Player Pro to export MPEG 4 video (MPEG 4 or H.264) from .mov to MPEG 4 with the Passthrough option for both video and audio. This preserves the full quality of both components but regenerates them as a .mp4 file, the name of which is simply changed to .m4v prior to tagging (if H.264).


Audiobooks: They’ve Come a Long Way

11 December 2007

There’s never been a better time to play audiobooks. The 2007 iPods are extremely intelligent when it comes to enhanced audiobooks, which are AAC files with a chapter track. These are functionally equivalent to enhanced podcasts.

Modelling this look here on a 3rd-Gen Nano is the final episode of the much-loved but inevitably cancelled Australian national radio show Get This, with the actually rather-famous comedian Tony Martin and his lovable young roguish companions, Ed Kavalee and Armitage Shanks:

Get This on 3rd-Gen Nano

This file has been stitched together from the three-part podcast that consists of the entire final show minus the music. I’ve removed the beginning and ending ads, chaptered the file and tagged it down to the release date and copyright information. It’s now a .m4b file, no longer an MP3 podcast, and appears in the Audiobooks library in iTunes.

Note the third line down, Slim Shady Sr. This is the name of the currently playing chapter. The first line is the name of the overall track. The progress bar is divided into the chapter markers. If you click forward or reverse, it will jump one marker. What’s really cool is the fact that once you’ve clicked the audiobook in Music > Audiobooks, the Nano and Classic show you all the chapters, like you’re looking at a music album. If you’ve stopped playing somewhere in an audiobook, then return to this menu, there will be a new item at the top, Resume, which allows you to rapidly pick up where you left off:

3rd-Gen Nano Audiobook Menu

Here’s what this audiobook looks like on a Touch:

Audiobook on iPod Touch

The Now Playing screen looks like any music track, but if you flip the cover, the chapters are broken down into tracks similar to what you see on the 3rd-Gen Nano and Classic. No Resume option as above, but tapping the audiobook will pick up from where it left off.

Oh, and why is the podcast of a radio show considered an audiobook? The basic logic is that it’s not music, so it shouldn’t be in the music library and I consider podcasts to be ephemeral, so I like to move the ones I want to keep out of the Podcasts library. There’s no other place to put these. They are “spoken word”, so that’s the stretch I use, plus they do lend themselves to this type of treatment. And this type of content is considered an audiobook at Audible.com.

PS: If you would like the above file, you can download it from here for a limited time.


TV Shows: Air Date or Production Sequence?

6 November 2007

The downside to TV shows is having to make the decision between tagging in air-date sequence or production sequence. I’ve found it common that episodes produced in a particular sequence are not aired in that sequence. There are probably many reasons why the show creators did this, but you must make a decision so that you can enjoy the episodes in a way that makes sense, if any continuity is to be maintained. Here are some examples:

The Venture Bros, Season 1. The DVDs presented the episodes in production sequence. Bad move. Three episodes from the end of the sequence, an event profoundly changes the show so that the final two episodes no longer make sense. I won’t spoil this for those who haven’t seen it, but I suggest you look up the air-date sequence on Wikipedia and watch it that way. I was pissed when this happened to me, but I didn’t know ahead of time. In this case, definitely tag them so that they appear in air-date sequence.

SpongeBob SquarePants, Season 2: The episodes appear on the DVDs in production sequence, but they were aired in a different sequence. There seems to be no good reason for this, particularly since the first season’s episodes’ production sequence is the same as they one in which they aired. In this case, I chose air-date sequence, but you could go either way. As each episode is an isolated story, you won’t ruin any continuity.

Blackadder, Series 2: Air-date sequence has episodes 1 & 2 reversed. It also violates continuity as a result, so I tagged them in production sequence.

The Weird Al Show: Production sequence was thrown out the window. When I listened to the commentary, it was clear that the air-date sequence was out of his control, and that’s the way viewers saw the episodes, so I chose the air-date sequence.

Family Guy: This is the worst organised set of TV seasons I’ve seen on DVD. In Australia, we’ve just had “Season 6″ released, but in the US, it was season 5. Also, three episodes are missing from the end of the season. This pattern started early on with these DVDs with the result that each DVD since season 3 actually represents the season earlier than it’s labelled. It’s a mess. The only clear choice was to put them in US air-date sequence and ignore the labelling.

My primary source of both air dates and production numbers is Wikipedia. I have found this to be relatively trustworthy. I also confirm when possible on the TV shows’ official sites.


I Discover Ringtones

6 October 2007

I’m not a “phone guy” and can’t buy an iPhone here in Australia, so I’ve let all the developments and hoo-hah regarding ringtones wash over me. I did notice an interesting item in Lostify that I’ve just had a chance to try out.

It’s probably been covered before and may not work with the 1.1.1 update, but I thought I’d mention a technique for creating ringtones that I’ve discovered. I should note that it’s a Mac-only solution.

Ringtones Library

As you can see above, I have a number of ringtones that didn’t come from the iTunes Store. I’ve never been interested in using music for ringtones. These are all comedy items, one from the Adult Swim website relating to The Venture Bros., and the others are from the popular Australian national daily radio show Get This with Tony Martin and Ed Kavalee. Here’s the technique:

You must use AAC (.m4a) files, so if your source is MP3, as all these were, use iTunes to convert them first. These all happened to be 128kbps mono, so I matched the bitrate but converted them to stereo in case there are any future incompatibility problems with mono. Here are the settings I used in Preferences > Advanced > Importing:

Ringtones Conversion Settings

Then delete the files from iTunes and take them out of the trash and put them in a temporary folder. I found that if I Lostified from within iTunes, iTunes didn’t refile them as ringtones, so you have to do the tagging outside. Drag all these files to Lostify 0.7. You can change all the tags you like, but this is the important one, File Kind:

Lostify 0.7: Set Ringtone File Kind

Apply this change to all your files (use the padlock next to the field so you don’t have to select it each time), then drag the files into iTunes. iTunes now sees them as ringtones and they will appear in the separate Ringtones library (you may need to turn on visibility in Preferences > General).

The Ringtones library behaves a little differently to the other libraries:

  1. You can’t drag these into a playlist.
  2. You can’t play all sequentially. If you play one, it will stop after finishing rather than starting the next in the list.
  3. You can’t use Album or Cover Flow views. You can tag ringtones with artwork, however.

So there’s a solution to create ringtones. Whether it works with an iPhone is questionable. I’d like to know if anyone using this technique finds success. For myself, it’s all a bit useless because I don’t have anything to use these with, but I enjoyed the opportunity to organise my ringtones into a separate library. Prior to this, these were in my music library, and of course, they aren’t music. It’s like when audiobooks were separated out into their own library. Much better organisation.

Update 15 Nov: With the advent of 1.1.2 iPhone and iPod Touch, it seems that you can easily add ringtones 30 seconds or less in length by renaming a .m4a file as .m4r and dragging into iTunes. I didn’t know that ringtones had a different extension. I still think it’s a good idea to Lostify them for completeness.