The Ultimate Index v3.0 – The Innerspace Labs Media Exploration Master Workbook is LIVE!

It’s been a magnificently productive day at Innerspace Labs and we’ve reached what is to date our most prestigious milestone. I published a feature last March about the evolution of my life-long list-making of sound works, cinema, and literature that I’ve been meaning to explore. These lists also served to touch upon some of the special collections in my archive.

In the previous article I described how this process began with leather pocket journals, and as the scale of my library grew I began to publish annual print editions itemizing large collections.

Innerspace Labs Archive Index Books 2013

Innerspace Labs 50 Top Artists Book

These efforts were radically transformed several years ago when I migrated to Google Drive. But as the years passed and spreadsheets and documents multiplied, it rapidly became apparent that I needed to consolidate all of these various lists into a single, deep searchable index otherwise countless lists would be forgotten and disappear into the digital void of my Google Drive.

Thus began the Innerspace Labs Master Workbook project this past spring. Though this venture posed several new dilemmas. As the workbook grew to nearly 200 tabs, I received this error stating that Google Workbooks are limited to 5 million or fewer cells.

Google Error 5 Million Cells Spreadsheet Workbook.png

And it quickly became evident that navigation of all those tabs was painfully arduous in the mobile environment, as was its loading time. Thankfully, after careful research into various potential solutions, I’ve implemented a system of scripts and formula expressions which make navigating this large workbook a snap and its interactive response time nearly instantaneous.

By combining over 200 named ranges, and incorporating a primary dynamic drop-down and a dependent secondary drop-down field, along with an “=INDIRECT(CONCATENATE” expression calling named ranges based on user input, I’m now able to hide and lock all but one master sheet and made the entire workbook navigable from that single homepage.

The home sheet offers the user a primary drop-down of LITERATURE, SOUND, or VIDEO, which in turn controls a secondary dependent drop-down to populate and auto-alphabetize a list of all related content for that category.

I’ve also employed a script which is triggered by Google Clock to rescan the entire workbook for newly-added lists and to automatically incorporate them into the search fields alphabetically and by category as the workbook continues to grow.

I understand that it may not have significant value to anyone other than myself, but it’s intended to serve as a reference document along with the over 200-pages of archive summaries I’ve drafted in a companion Google Doc. With this easy-to-reference Workbook, I can pull up a list in seconds and start exploring. My hope is that the project helps introduce me to some spectacular content and that it helps me rediscover forgotten areas of my library.

The next phase of the project is to apply uniform formatting to all lists, as these were drafted independently over the course of nearly a decade, so I apologize for the crudity of its present format. And of course, there may be errors or omissions among the lists. But you know that I’ll work tirelessly to make this project as accurate and accessible as I can.

Here is a link to a copy of the latest version. It showcases and attempts to organize ~26,000 of the most noteworthy elements of my personal library and related subjects of interest. All cells are locked for editing except the two dynamic drop downs, which is sufficient for general users to explore and interact with the document. It’s far from perfect, but it’s a labor of love that I will continue to work on and which I hope will enrich my life as it continues to expose me to some of the greatest works of the ages.

The Ultimate Index: The Innerspace Labs Media Exploration Master Workbook

February has been a whirlwind of productivity and I’m excited to share the results of my efforts. Thus far I’ve introduced five projects. First I discovered that the disk snapshot solution I’d been employing for my server would no longer work at its current scale, so I had to research and implement a new solution. Once that was a success, I set myself to the task of merging and updating two music database systems I’d created years apart on two different operating systems. That was an incredible challenge.

The next three projects were featured here at Innerspace Labs – first the Nipper RCA “His Master’s Voice” project, then the six-hour drone high-fidelity ambient experiment with Eno’s Music For Airports, followed by the Fred Deakin archive update. But it was the sixth subsequent undertaking which would consume countless late night hours as the latest project continuously exploded in scope and scale, each time introducing new challenges to test my problem-solving skills.

For as long as I’ve been breathing, I’ve been compiling and organizing lists of all manners of subjects. I thrive creating order from chaos – chronicling and curating media of the 20th-century. As a young man, I penned lists in leather pocket journals but was frustrated by the fixed and static state of the data one committed to the page. I quickly graduated to Microsoft Office and then to LibreOffice, and by 2013 began self-publishing books of collected lists and spreadsheets to document the progress of my archive.

Innerspace Labs Archive Index Books 2013

Innerspace Labs 50 Top Artists Book

But the true game-changer came when I adopted the Google suite of apps, most notably Google Docs, Sheets, and the Google Keep task manager. These applications introduced undo history, increased accessibility, and most importantly, shareability to my list-making efforts.

Still, the seamless convenience of Google Drive came with a caveat – scores of lists once generated were quickly forgotten, and the sheer number of them made Google Keep and Google Calendar reminders cumbersome and an ineffective method of managing them at this scale. What I came to realize was that dozens of quality sets of information were disappearing into the digital black void of a Google Drive overrun with lists.

That’s what inspired this latest project. I decided to survey my entire history of list-making, compiling databases created in a wide array of formats and constructed on multiple platforms over the years, and to merge them all into a single workbook on Google Sheets. It was an incredible challenge, as the formatting of the data varied tremendously from .M3U to .PUB to raw .TXT to .XLS to proprietary database systems built for Windows XP (OrangeCD), to web-based database systems like Discogs and Goodreads which each offered .CSV exports.

To depict folder-structure-based organizational systems, (commonly employed for artists and label discographies), I utilized tree -d list.txt for large libraries. To extract %artist% and %title% metadata from RYM toplist playlists I’d constructed, I developed a spreadsheet combining four formulas to pull nth row values and to truncate “#EXTINF:###,” expressions and file paths from .M3U lists outputting a clean list of tracks.

In October of 2017 I’d authored The Innerspace Labs Journal: A Listener’s Guide to Exploration in Google Docs as a contextual survey of my larger collections. It spans eighty-four pages and includes an active hyperlinked TOC with an X.XX indexing structure and served my needs well for the past two years, but for simple down-and-dirty lists a spreadsheet seemed like a more accessible format.

Screenshot of Innerspace Labs Journal A Listener's Guide to Exploration

And so I constructed this latest effort – The Innerspace Labs Media Exploration Master Workbook – a cloud-based 180-tab set of spreadsheets combining all of my list data into a single, searchable, sharable index with a hyperlinked Table of Contents for easy navigation. The interface is intuitive, it loads lightning fast on even the most modest of systems and across all browsers and platforms, is mobile-friendly, and it will continue to grow as new content is introduced to my library.

The TOC is segmented into four primary themes:

  1. Literature and Essays
  2. Cinema and Television
  3. Sound Pt 1: Music Surveys, Best-Of Lists, and Guides
  4. Sound Pt 2: Artist Discographic Chronologies, Audiobooks, and Old-Time Radio Dramas

While a few of the tabs contain hyperlinks to lists from multi-page sites which do not send themselves well to text extraction, I’ve done my best to embed as much of the information as possible locally in the workbook, itself and to keep the layout consistently uniform to facilitate navigation and clarity.

Screenshot of Innerspace Labs Media Exploration Master Workbook

Unlike the self-published books or the somewhat daunting length of the Journal, this workbook is simple and localizes the data a viewer is most interested in exploring to a single, plaintext sheet for quick and easy reference. The shareability is key to aiding curious listeners/viewers in finding quality content relevant to their interests, and it is simultaneously a tool to empower me to delve into the many areas of my own library which I’ve yet to explore.

This is a milestone for Innerspace Labs, and I will continue to refine and expand the project into the future.

Are the Floodgates of Public’s Access to Information and of Global Communication Irreversibly Open?

Siva Vaidhyanathan’s writings on piracy culture, particularly The Anarchist in the Library, references numerous examples of the church and crown’s efforts to maintain a stranglehold on the flow of information to protect their power.  In a chapter discussing the history of control, there are clear parallels between the Catholic Church and those of the United States with the implementation of The Patriot Act.

In the 14th century, John Wycliffe was the first to produce a handwritten English manuscript of the 80 books of the Bible.  44 years after Wycliffe had died, the Pope declared him a heretic, banned his writings, and ordered a posthumous execution.  His bones were dug-up, crushed, burned, and scattered in a river.  Similarly in the 16th century, William Tyndale was the first to translate and print the New Testament into English.  As a result he was imprisoned for 500 days, strangled and burned at the stake.


William Tyndale, before being strangled and burned at the stake, cries out, “Lord, open the King of England’s eyes”. woodcut from Foxe’s Book of Martyrs (1563).

By the dawn of the 21st century, the freedom of information that came with the printing press experienced its most-recent incarnation with the world wide web and social media.  The Patriot Act was the government’s struggle for control over the anarchic freedom that was the internet and came in the form of mass-surveillance.

Edward Snowden became the latest in the line of dissidents who worked to empower the public by exposing the corruption of the government, just as Tyndale and Wycliffe before him.  And a curious web search for the terms “Spanish Inquisition” + “Patriot Act” instantly returns a piece by Walter Cronkite comparing and contrasting the two systems from 2003.

Wikipedia co-founder Larry Sanger states in his article, Who Says We Know that “Professionals are no longer needed for the bare purpose of the mass distribution of information and the shaping of opinion.”  This same dissemination of distribution is what resulted in the music industry’s panic and frenzied struggle for control with crippling technologies like DRM and its continued anti-piracy campaign.  There is simply no longer a need for the monopolistic record labels that once commanded the industry.  Artists are empowered to distribute their content directly and can communicate with their fanbase without a commercial intermediary.  This artist-empowerment is expertly discussed by Amanda Palmer in her book, The Art of Asking (and in her TED Talk of the same name.)

20141103.Amanda-Palmer_TheArtofAsking-635-2-thumb-620xauto-80148Amanda Palmer’s The Art of Asking

In each of these milestones in the history of information freedom, the acts have been irreversible.  Gutenberg’s printing press empowered the public good through democratization of information – making it inexpensive and readily-accessible.  The web has been much the same, only exponentially more potent.

Still, small but persistent communities continue to prepare for a dystopian world war over information.  They archive the Wikipedia daily and hypothesize alternate methods of mass-communication should the Web as we know it come under fire.  Is their fear valid?

An eBook export of the Wikipedia

It is difficult to envision a scenario in which first-world governments could close the floodgates of the world-wide web without immediate and drastic reprisal from the public at large who have come to view the internet as a right and a public utility.  Furthermore, global commerce, banking, and the mechanics of industry could not likely stand to make such a sacrifice in the name of control.  Shutting down the web would thrust the global economy into an instantaneous dark age and entire systems of utility, government and finance would collapse.

What are your thoughts?  Is our access to information irreversibly free?  Need we take measures to stockpile and protect the information we have today in preparation for a darker tomorrow?