Blackle.com: Energy Saving Screen.....Bahhhhhhhhh!!!!

We love testing. Its what makes an analyst get up in the morning and drive 15 miles through bumper to bumper traffic a different way everyday to find the optimal path. Its what makes us count our gas efficiency in our Honda. It makes sense. Its who we are. In the spirit of this, CableOrganizer has taken to some additional testing methodologies with regard to the internet. Some of these have some very real world ecological implications. On this occassion, we've taken to getting to the real story behind Blackle.com.





Blackle.com touts a running count of how many Watts it has saved. This is a counter based on the idea that the level of energy consumption from non-illuminated pixels is significant enough to actually help ebb the wasteful flow of energy from the 17" screens in front of each of our faces. Did we believe it? Hell No baby...we question everything. At first thought, I said, I'll bet its true. I admit, I know nothing about LCD energy consumption. So, Paul, myself, and Jason Hernandez, the sales associate at the company who brougt this to our attention, slated and performed a test to see what the truth was. Hint: Get Snopes.com on this right away.

Our test included one 19" flat screen LCD model E197FP, FireFox 2.0 and a Watts Up? EZ Electrical Consumption meter in our offices. We opened the browser to the Google.com page, and opened a tab to the Blackle.com page. When in the primary position, Google.com consumed 28.2 watts, give or take 1-2 tenths of a watt. When we switched over to Blackle.com in the same browser, pointed to a primary navigation position, the same monitor consumed 29.4 watts, give or take the same confidence interval. In order to help with our validation of this test, we performed the test again with the camera running for everyone to see. Now, keep in mind, we did not use a CRT (Cathode Ray Tube) should that be the majority of screens used, maybe the explanation of consumption would be viable. However, with the percentage and pervasiveness of LCD, the expense of the site does not justify or envirtue its existence.

Now, this has peaked our interest. The meter itself is fun. We can measure in volts, amps, watts, or even set it to record how much money each item will cost. Business and residential users alike have to love the fact that you can see Watt your electrical bill will be before you get it and how much each appliance is costing. True, at least for me, that our utility (FP And L) actually provides this data to help curb excessive consumption of energy. But, for some, this may actually make a difference in expense, and aid in the battle for awareness of consumption. Imagine that...

CableOrganizer.com INC. 500 # 126

I'd like to take an opportunity to brag a bit about the company where I work. I know many people out there who have a great deal to hold over us. There are companies which sell very consumer friendly things like purses or jewelry, and companies which sell consumer electronics. For those companies, success comes in the form of large revenues and the ability to say that they compete. For CableOrganizer.com, our success is measured in the ability of 30+ geeks and nerds (insert loving and empathic tone) to carve a living out of selling hand tools and server racks. Most of our market barely knows they can utilize our site, much less visit and purchase.

So, in honor of our being listed as an Inc.500 Company (number 126) and as a validation of our collective feeling of achievement, I have decided to splurge in grabbing your attention by including a link to a press release for our Big Little Business by the Beach. Please read and enjoy...

CableOrganizer.com Named to Inc. Magazine's 26th Annual List of America's 500 Fastest-Growing Private Companies
— having realized astounding
3-year sales growth of 1,413.3%.

Putting Limitations in Their Place in Google Website Optimizer

This appears to be an area where I'm finding new and exciting things to discuss with regard to the ability to run multivariate tests on page elements within a site. In the spirit of Google and its pursuit of excellence in business and academia, and its willingness to allow us to push the limitations imposed upon us by ourselves, I've decided to open a post with the idea of having people respond with possible obstacles to their testing which they have conceived of, and have prevented them from executing a test in GWO. Here's how it works:

You tell me the situation: You, your boss, or some smart-(insert posterior here) in your office has created a mental block to performing a high-level, and very useful multivariate test or A/B test which, if run, could produce a multitude of insights and win you office praise, and put the cherry on your bonus. You have Google Website Optimizer and a thorough understanding of the major points which promote your ability to test. If only this one thing, this tiny script or tag, or placement, or file type wasn't there, you would be all set. What is that thing, that, Bucky Dent of a item which is a severe detriment to your intracubicle ticker-tape parade?

We Take a Look: You, me and the boss....my boss. We sit down and examine the test. In doing so, we will carefully look into your problem and create a version of the problem outside of your live site. Then, we'll go to work building the solution necessary for you to get exactly what you want out of the test without a serious loss of resources; mainly time and money.

We Form A Plan: When we've come up with some theoretical work-arounds for the problems which we plan on eliminating, we'll implement them in a basic operational test. At this point, we'll also choose the appropriate place to collect success (thank you page, cart addition, proxy page, etc) Let'em rip without a sincere impact on your live traffic or their variations. This will cost you a spot on your Google Website Optimizer list, which means nothing and costs less. But it will confuse you if you go back and wonder why you have multiple tests with the same name. Be ready.

Launch the Test: After the tests produce acceptable results, we'll launch the fully-prepared test. This includes plimping your multivariate test to the thousands of visitors who will (or not) react to the output bringing back valuable stats to your interface. In a few days, we'll check up to ensure that you're getting the right stats and collecting what you need.

Allow for Completion: As a rule, we try to not look at the test progress on these everyday. We suggest the same, simply for the preservation of sanity. Looking at the way these items interact and change and progress can be like watching a horserace in ultra-high speed film. By that I mean, the suspense is terrible, and it goes on forever. You start to formulate hypotheses about events which aren't really ocurring and a whole slew of other non-useful behaviors.

Analyze Results: Take a good look at what the outcome was. Go back and verify your files to ensure that you received all the collection tags as they were executed. Then, use your information to make a follow-up experiment. Avinash implies in his book that you can narrow these from the field earlier on than the completion of the test, but, for our methodology, we will not. Take the top five variations and a 'dog' or two, and place them out again to verify the results.

HERE'S THE CATCH
Something for nothing is a great idea at family retreats and picnics at the park, but it doesn't work that way. So, for the effort of putting together a test and its strategy, we're going to ask you for two things, which, considering the payoff, may be extremely cheap for the return and praise you may receive. We'll discuss it when you have a chance to write me on the blog or in the Yahoo! Group.

Update: Call-To-Action on Button Color Outcome

Quite a few weeks back, I wrote about the colors of buttons and their ability to appeal to buyer's impulses on an ecommerce site. Since then, I've placed 8 different buttons in two element areas on a deep path page in the cableorganizer site for testing. Using both Omniture and Google Website Optimizer, I was able to produce a positive correlation between our 'View Pricing' button on our Product Detail pages and sales conversion (represented in a proxy with the addition of an item to the shopping cart). The process is as follows:

1. Using whichever metrics you choose to determine a page which can yield good results quickly, choose the page on which you expect to have the greatest impact by testing. (We actually use a few calculated metrics which help us determine these; they include: primary content composition(the percentage of total entries on which this page is the landing page within the context of the path) bounce rate, and a highly complicated weighting algorithm (developed out of the idea of proxy-measurements) to determine the importance of each page, within their context, with relation to their path, in the sequence of conversion.



2. When the page is chosen, set up the testing scenario in Google Website Optimizer for the purpose of a multivariate test on chosen elements. Ensure that all the tagging is done and there are no overlapping elements, tables, or div tags between the script/noscript tags.



3. Create multiple elements for each of these sections. My suggestion is to always include at least one or two 'crummy' variations on the elements. That way, you can verify their relevance rating in the process. It may lengthen the test, but it will also strengthen the output.



4. Using Omniture, or whichever provider you are using, you can place a 'Custom Link' inside of each of the element tags which you hope to verify. Make sure each "custom Link' is unique so that when each is clicked, they show independently of each other. For our purposes, we laid each out with a color combination as to immediately present us with an idea of what was happening. (Also, make sure you place these in the appropriate report suite or ASI segment as necessary. Internal traffic could influence these if you are not careful. )



5. Set your tests up completely and hash-out the previews before launching. Look at how they appear in different browser sizes. Know what your users will be seeing.



6. Lastly, set up your cookies to not expire for an extended period. Make this period equal to whatever you find to be the average amount of time your customers take before making a purchase from the page which you are testing. Remember the Google code for this is made up of seconds. (i.e. 3 days equals 259,200 seconds).

Once you've ensured that all of this will work, you can feel comfortable letting the test loose.

Having received significant data from the test being performed in both Omniture and Google Website Optimizer, I'm sure that the results which I can see now are having the true correlational effect on our conversion. The really funny thing is, now that I see this ocurring with such high relational specificity to this page, and the context of the images within the colors contained within the page; I am met with more perplexing questions. These are of the type which appeals to my nature of understanding peoples consumption of visual cues with respect to the composition of a painting or image. Shapes and colors play off one another. Does this mean that because the color dominating the top button is present in the page and this is the centermost position of that color that I may have to find the individually best color for each button on the page? If so, is there some concentric model which can help explain shades and variations of intensity of colors to create the visibility, appeal and action on these colors? I'd be very interested to hear any explanations on this topic or tests which have been performed with regard to them.

As usual, I love to spend time thinking about and discussing advanced principles in testing, analytics, optimization and, well, anything about this field. If anyone has any ideas or suggestions, please feel free to contact me. I have been very busy for the past five weeks, but I think my posting may become more frequent for at least the next couple months. If I don't get back to you right away, it only indicates I am busy trying to keep my job.