Link Harvester returns: unique linking domains their IP addresses & unique c block addresses of the links links from .gov, .mil, .edu, or .ac.uk domains. Links from these domains are likely rated better in authority type algorithms such as Hilltop or TrustRank. Link Harvester also bolds and autochecks domains that link from 5 or more pages. You can then requery the Yahoo! database and spider deeper than the 1,000 link limit. Link Harvester uses the Yahoo! API, provides CSV outputs.
With a limited number of recoveries nearly a year after Panda, the first bite might seem like a big concern, however the "too many ads" algorithm updates far more frequently than Panda does:
If you decide to update your page layout, the page layout algorithm will automatically reflect the changes as we re-crawl and process enough pages from your site to assess the changes. How long that takes will depend on several factors, including the number of pages on your site and how efficiently Googlebot can crawl the content. On a typical website, it can take several weeks for Googlebot to crawl and process enough pages to reflect layout changes on the site.
And for those who got hit by Panda then tried to make up for those lower ad revenues with more AdSense ad units, they probably just got served round #2 of Panda Express. ;)
However Google has such a rich data set with AdSense that I don't think they would just look at layout. If I were them I would factor in all sorts of metrics like
AdSense CTR
average page views per visitor
repeat visits & brand searches
bounce rate
clickstream data from Chrome & the Google toolbar (so even if you are using other ad networks, they can still sample the data)
Some sites are primarily driven off of mobile views while other sites might be seen on large monitors. When Google sees every page load & measures the CTRs, tacking actual user response is better than guestimating it.
They could come up with some pretty good metrics from those & then for any high traffic/high earning site they could manually review them to see if they deserve to get hit or not & adjust + refine the "algorithm" until those edge cases disappeared. Google's lack of credible competition in contextual & display ads means they can negotiate pretty tough terms with publishers that they feel are not adding enough value to the ecosystem.
It's Not Just Algorithms Cleaning Up AdSense
In addition to these sorts of algorithms, over the past year they have manually hit networks of sites with the doorway pages label & disabled ad serving on sites or entire accounts where they felt there was a bit too much arbitrage. One of our SEO Book members pointed me to this thread where a lot of Pakistani AdSense accounts got torched last October & another sent me a sample termination email from Google similar to this one:
Notice that in the above:
There was no claim of click fraud, copyright issues, or anything like that.
There was no claim of advertiser complaints.
Google offers no customer support phone number, no "you might want to work on this" advice, doesn't list which of the sites in the account they felt could be improved, and RETROACTIVELY nuked past "earnings" ... depending on where it is in the schedule that can amount to anywhere from 30 to 50+ days (I remember Teeceo mentioned how they waited until the day before the AdSense payday to smoke his stuff way back in the day to have maximum impact!)
On Google's latest quarterly earnings call they highlighted how year on year Google's revenues were up 25% but the network revenues only grew at 15%. They also explained the slower network revenue growth as being associated with improved search quality & algorithm updates like Panda.
Left unsaid in such a statement was that until those algorithms rolled out, Google admitted they funded spam. ;) The whole AdSense & content farm problem was created through incentive structures with unintended consequences.
Is the Garbage Disappearing, or Just Moving to a New Landfill?
If you track what is going on with the Google+ over-promotion (long overdue post coming on that front shortly!) or how Google is still pre-paying Demand Media to upload video "content" to Youtube, Google still may be funding the same model, but doing so while gaining a tighter control of relevancy so they can better sort good stuff from crap (when you host content & track user response you have all the metrics in the world to determine how relatively good you think it is). If they over-promote these sites then in the short run they create the same skewed business model problem.
Sure hosting the user experience makes it easier to sort the wheat from the chaff, but the other big risk here is the impact on the rest of the publishing ecosystem. There will be lots of thin spam from popular people on Google+ (anyone launched a celebrity-focused Pay-Per-Plus site yet?) & in-depth editorial content might not be economically feasible in certain categories where there literally is no organic SERP above the fold.
I will complement them on their efforts to clean up some of the worst offenses (from the prior generation of "bad incentives"). If you were hit by it, Panda was every bit as big/brutal as the famous Florida update. If this update is anything near as significant as the Panda update (in how it impacts smaller independent webmasters) then it is going to force more of them/us to move up the value chain.
That may mean pain in the short run, but (for those who take it as a wake up call to develop brand & organic non-search traffic streams) far more rewards in the longrun for those who remain after the herd is thinned.
My grandfather was an autoworker, and I have a weapon he manufactured to protect himself from the company that he would carry to work. It's a big iron pipe with a hunk of lead on the head. I think about how far we've come as companies from those days, where workers had to protect themselves from the company.
I think for many SEOs the idea of starting over is painful, but the best SEOs often enjoy the forced evolution & the game of it all. They don't roll over & play dead or forget SEO. And if Google didn't put hard resets in every once in a while, then the big hedge funds would be mopping up the SERPs and cleaning our clocks with the help of Helicopter Ben.
Areas For Improvement
Of course this could be taken as a positive post toward Google (and it mostly is), but I don't want to come across as a fanboi, so I thought I should do a shout out to a couple things they still need to fix in order to be consistent:
If Google is going to tell people that thick deep content is needed to gain sustainable exposure then they shouldn't be ranking thin + pages in the SERPs just because it is a Google product. Even people who have *always* given Google the benefit of the doubt (full on fanbois) found the Google+ placement in the SERPs distasteful.
Google's AdSense is still sending out some of those automated "you are leaving money on the table" styled emails reminding publishers to use 3 ad units. If such behavior may lead to a smoke job, then the recommendation shouldn't be offered in the first place. Right below the "use 3 ad units" there needs to be a "proceed with caution" styled link (in red) that links to the recent "too many ads" post.
Old case studies that are no longer in line with best practices in the current market should have some sort of notice/notification added to them so new webmasters don't get the wrong idea.
Some of the AdSense heatmaps are roadmaps to penalization. These should have been fixed before yesterday's announcement, but if they are still up there next week then Google is willfully & intentionally trying to destroy any small business owner that follows that "best practice" advice.
Your Feedback Needed
Since this update impacted far fewer sites than the Panda update, there are fewer sample/example sites. Did any of your websites get hit? If so, how would you describe ...
It is not going to be possible to give you the exact details about how the different search engines work. The search engines do not want you to know how they do their work and they also change their procedures quite regularly. SEO tools that work one day may not work the next day because [...]No related posts.
Even though you cannot be guaranteed that your blog will get to the top of Google or any of the other search engine results pages by using search engine optimisation (SEO), you can definitely be sure that it will help. The reality is that there are no guarantees but you want your article to have [...]No related posts.
Displays the approximate age of a website on the Internet and allows you to view how the website looked when it first started. It also helps you find out the age of your competitor's domains, older domains may get a slight edge in Search Engine Rankings.
is used to measure the difficulty of optimizing a Web page for a key phrase for ranking with Google. The rating is given in percent. You add your key phrase and 3 top bids for the keyword in Overture. Requires a login account, Amazon API key, Google API key and a Yahoo Addlication ID.
displays inbound link reported by Alltheweb, Alta Vista, Google/AOL, HotBot, MSN & Yahoo and provides a total of them. But what makes this tool shine is its new trend/history report. Yes that is correct it will give you the history of links for your site. Now that is hot!
Now with many advertising tactics around, as well as a substantial variety of promoting tools getting introduced, companies tend to be often left lost as to precisely what technique they will need to utilize. Gorilla promoting is becoming an exhilarating method for men and women to be able to market their own products and services. [...]No related posts.
allows you to enter a search term and the domain to search for. It returns the position that search term has on Yahoo with, the number of entries that search term is indexed for, size of file, and the number of inbound links the site has.
will generate a list of keywords and keyword phrases used in other web sites based on the keyword or keyword phrase you enter into their tool. This tool searches other sites with your choice of one of the 9 listed search engines and displays what other web sites that are optimized for the keyword phrase you entered are using for keywords on their site. Very helpful tool!
If you’re an Internet marketer that’s trying to leverage YouTube, you should know how important it is to build a strong foundation on it so that you’re able to achieve long term success. Remember there are many areas of opportunity that still exist using video, and if you want to diversify your marketing you should [...]
Blacklink analyzer that provides a report of the URL and anchor text of up to 1000 of your backlinks that Google is showing. If you have more than one link on the inbound page it show each of the anchor texts.
gives you 10 seperate fields to enter domains and gives you the same day, 1 week ago and 3 month average Alexa Rank. It also shows the movement up or down in the last 3 months.
displays inbound link reported by Alltheweb, Alta Vista, Google/AOL, HotBot, MSN & Yahoo and provides a total of them. But what makes this tool shine is its new trend/history report. Yes that is correct it will give you the history of links for your site. Now that is hot!
gives you 10 seperate fields to enter domains and gives you the same day, 1 week ago and 3 month average Alexa Rank. It also shows the movement up or down in the last 3 months.
Checks link pages and reports if there are links to bad neighborhoods. The tool also has the ability to search on multiple levels (so for example if you maintain a directory it is able to spider the categories and subcategories).
If you want to benefit your online business, then as an Internet marketer, you will always need to be well equipped to taking that next step. Creating a podcast is something that can immensely help you build a strong relationship with your target audience and actually give real value to them. below. Give Good Quality [...]
will analyze your entered URL, and return a list of key phrases with their corresponding density values for one, two, or three word key phrases. You can choose whether you want the longs key phrase to be 1, 2 or 3 words long.
If you want to benefit your online business, then as an Internet marketer, you will always need to be well equipped to taking that next step. Creating a podcast is something that can immensely help you build a strong relationship with your target audience and actually give real value to them. below. Give Good Quality [...]
Hiring a professional SEO expert for a local business has become imperative because more and more local shoppers are no longer consulting the Yellow Pages, newspapers and other printed materials but instead are using online resources. The sustainability of the local business could be severely compromised if it does not have a site for local [...]No related posts.
If you want to benefit your online business, then as an Internet marketer, you will always need to be well equipped to taking that next step. Creating a podcast is something that can immensely help you build a strong relationship with your target audience and actually give real value to them. below. Give Good Quality [...]
Google collects a lot of information on individuals & can have some level of confidence if the person is a real person or not based on things like their history of email usage, if they have a credit card on file, how they interact with other high confidence real accounts, how many people are friends with them on Google+, usage of an Android cell phone, their search history, etc.
Google doesn't need all those signals on any individual, just some blend of them.
From there they can create a lot of usage-based brand signals.
Query Volume + Click Distribution
For any keyword Google can see the search volume & the click distribution on the search results.
If a lot of people click on the top result & very few people click on the second or third result there is a strong chance the keyword is a brand. If the click distribution is spread more evenly across the search results then it is less likely to be a brand keyword.
The above was a hypothetical example, but the following image shows how lower volume branded navigational keywords can drive far more traffic than broader industry keywords. We get twice as much traffic for seobook & seo book as we do for seo.
Query Chains
When people search for a generic keyword they may (immediately or later) modify their search query to search for related keywords. In the past Microsoft offered a search funnels tool that would show common searches before & after a keyword. If someone searched for credit cards they might soon search for visa or mastercard.
Of course getting the user to click is just the first step. From there you must satisfy them. ;)
If you visit a page quickly & then jump right back to the search results Google asks users for an explicit vote against that site. And if you visit a page for a significant period of time Google asks users for an explicit vote for that site. That Google is measuring the time until return the search results to determine which explicit vote to request also implies that they can use the same aggregate data to create an implicit signal.
Where this measurement can get a bit fuzzy is that Panda can create a self-reinforcing impact (good or bad).
Some examples...
Self-Reinforcing Positive Impacts
Let's say your site got a ranking boost by Panda. It will rank higher across broader industry keywords, to where people may enter your site at the category level (say shoes or Nike shoes) and then surf around your site quite a bit. This equates to a longer time on site & a better user experience.
2 more factors on this front are branded navigation & familiarity.
On some search results Google shows branded search options.
If clicking those brand & store links feeds into the Vince relevancy signal, then any brand featured there has a huge wind at their back, building further brand signals. Eventually such suggestions can work their way into Google Instant keyword suggestions as well. Even if people do not click on those particular options, the various highlights in the search results act as advertisements for the brands, which drive incremental demand and search volume for those brands.
Amazon.com is responsible for roughly 1/3 of ecommerce spend in the United States (outside of travel), so many people might go and research product options generally & then conclude those search sessions by seeing if they can buy it off Amazon.com (due to getting free shipping & the high level of user trust Amazon has). As this becomes part of search relevancy algorithms this is the online equivalent of going to your local Borders store to find something to buy & then buying it on Amazon. In the short run you save a few Dollars, but in the long run stores like Borders go out of business.
Self-Reinforcing Negative Impacts
There are 2 bad ways a business can be impacted by Panda. One is missing out on the above promotional options that a large competitor may enjoy, which over time build more brand signals for them & leave your site stranded in no man's land until it is finally clipped by Panda for lacking "quality."
A second issue is a self-reinforcing issue with Panda. On WMW a user nicknamed Walkman described it as the "size 13 shoe problem." After you have been hit by Panda you are not likely to rank for broader category level searches. However you might still rank for some really obscure longtail keyword that is uneconomic to address directly (and thus only have a glancing mention of the user's intent). Your page might say we do not carry size 13 or size 13 out of stock and your Panda-hit site ranks for "Nike Carmelo Anthony size 13." Thus the user bounces, creating a self-reinforcing negative user experience signal.
A third (non-Panda) issue that can cause poor user experience metrics is when Google mutates the search query in a way that makes the organic results irrelevant.
The above examples of +1 votes and blocks can be used (along with the time on site & repeat visits) to gauge user satisfaction, however if they can't get enough engagement then it will be very easy for big brands to buy that signal for pennies on the Dollar, as some social signals are easily bought by brands.
Not only does Amazon directly integrate promoting your wishlist on social media ... ... but they also have done interesting promotions like a "Tweet & get" ...
Imagine if/when a new local Wal-Mart store launches offering a free $10 coupon to everyone who Tweets their savings at the checkout counter!
One big issue I have with the +1 votes & blocks is that they apply across the board. I may dislike some craptastic videos hosted on YouTube, but there is also a lot of great content there. I love eBay for vintage video games, but it does not mean I love them for books.
Likewise some of the friend of friend stuff can be a bit off.
At some point Google should make +1 votes & blocks more granular.
Near the end of this article I will also further discuss some issues with ad votes.
Repeat Visits
Does Google measure repeat visitors? Yes.
They use that user interaction to ask for an explicit vote... ...and they can use it as an implicit vote as well.
They not only track how many times you visit a page or site, but also when you last visited it.
User Location
Once it is obvious Google is counting certain types of user metrics (just like they count links) there will be a race to the bottom to provide those said signals. That race to the bottom will lead to such signals being sold by accounts that either have sketchy trust metrics associated with them (if done through automation) and/or in markets with lower living costs.
And they can also track where the votes come from.
Domain Name
If your domain name matches your keyword that may be a brand signal. However, Google may also look at some other signals (like user engagement, repeat visits, relative CTR, etc.) as confirmation signals on this front.
URL Links
Sometimes when a spammer builds links they trap themselves by using the same anchor text too much. Whereas when a branded website pulls in organic citations the anchor text tends to be mixed up, like...
Diversity in any sense (anchor text, linking sources, pages being linked to, links built across time, etc.) is generally considered a good thing.
Other types of links might also be seen as potential brand signals. For instance, frequent exposure in trusted news sites, other trusted seed sites, or other known brand sites could pass additional karma. Some link spikes that are also associated with strong direct traffic spikes, strong referral traffic from the links, and strong brand searches might also boost the weight given to links.
In local search Google has long used the sites they displaced in the organic results as citations (even if they were in some cases unlinked).
In addition to offering branded filters in their internal navigation, many merchants submitting their products to Google product search may also be giving Google signals about which brands matter.
Google will be able to lean into Zagat ratings for business & other data sources (Google Wallet, Google Offers, etc.) will provide additional signals to Google.
Advertising
Any type of non-search distribution you have (RSS subscribers, email newsletters, mobile applications, physical stores, membership loyalty programs, etc.) makes it easier to influence search engines.
If advertising with Google had a negative impact on search relevancy you can be sure that the relevancy algorithms would change. Whereas if there is a convenient positive spill over then Google won't complain. In fact, they will even go out of their way to advertise that spill over. Any sort of advertising you do increases brand awareness. And that leads to additional incremental brand searches (and thus brand signal)
More exposure also leads to more user experiences, which in turn leads to more opportunities for people to leave signals behind (be it links, social mentions, additional brand searches, and/or repeat visits). Here is State Farm buying *irrelevant* brand signal for pennies on the Dollar.
And of course there are all sorts of corporate advocacy ads as well.
On YouTube Google counts some ad views as organic views (thus undermining relevancy) and more recently Google has implemented the controversial policy of putting +1 buttons in display ads.
Even if those votes don't influence rank directly, they still influence user perception. And what is so bad about that is that users are only voting of the content of the ad. This basically is the equivalent of cloaking.
If the landing page doesn't match the ad (free iPad anyone???) then people are going to see their friends vouching for scams & get duped by Google.
That is worse that a press release being advertised as though it was news
You can also be certain that some clever spammers are integrating +1 buttons in display ads on other ad networks in ways that may automatically collect user clicks & so on, or have users pay for viewing their next porn video by clicking a +1 button (much like some old school email spammers used porn viewers as manual captcha breakers).
Google does offer the ability to vote against an ad as well, but if an ad looks great upfront & its the landing page that scams you then how exactly do you vote against it if you don't see the site until after you click the ad?
is a toolbar that installs on FireFox and shows you the pagerank number for each webpage you visit. Beware - this tool bar will make you more PageRank conscience.
"All things are subject to interpretation. Whichever interpretation prevails at a given time is a function of power and not truth." - Friedrich Nietzsche
Everyone Except Me Should be Open
Being labeled as open or transparent is a great public relations strategy. Executed effectively it gets ditto heads to feel like they are part of a movement and spread your propaganda.
However actually being transparent is often a poor business strategy.
Claiming to run an open auction, while running obfuscated quality metrics that price gouge advertisers.
At the same time Google is trying to push social sites to offer transparent data, they decided to block some Google search referral data (unless you are paying for the clicks, then you get that data).
When planning some of the features behind Google+ one of their employees wrote a book about the social circles concept with Google's blessings. Then, after he wrote the book, Google revoked permission to publish it!
Nuking affiliate links of some websites & then investing in Viglink, a network that automatically turns links into affiliate links.
Burning some networks of websites for being doorway pages & then investing in the Whaleshark Media roll up & launching Google Places.
Nuking some UK financial comparison sites for link buying & then buying BeatThatQuote.
Suggesting 60 or 90 days of penalty is a reasonable penalty for sketchy links & allowing BeatThatQuote to rank 2 weeks after penalizing it without cleaning up any of the paid links.
Android is open but internal Google emails revealed that carriers were getting wise to Google using compatibility as a club.
Not sharing revenue share stats with AdSense partners for a half-decade.
When websites are nuked they are frequently given no explanation. Worse yet, their content often re-appears in the search results on some other domain that stole it, in many cases while being wrapped in AdSense ads.
Arbitrarily making it hard to export AdWords campaigns to other services (& making it against the TOS to do same via the API).
The Panda update was needed to rid the web of garbage content. And yet Google is pre-paying Demand Media to post videos on YouTube. Since the Panda update downstream Google traffic to YouTube has more than doubled & YouTube is serving over a trillion streams per year!
Calls for "transparency" in SEO may sound great on their face, but once you peal back the covers the absurdity is laughable. If Google didn't discriminate against certain types of players & if Google didn't compete in the very markets that it judges then perhaps transparency would be a good idea.
However Google is perhaps the single biggest direct competitor in many markets, so to be fully transparent with them when they are the opposite with you is a naive business strategy:
I also disagree that outing each other would make the industry less like a mafia, because SEOs aren't the mafia. SEO is a symbiotic marketing channel reliant on Google, until the next big search engine/method comes along. In a mafioso analogy, Google would be the mafia - as they control the market. Removing all webspam wouldn't necessarily create better search results or a fairer market, as Google still decides who wins and who loses. The biggest winner being Google itself, the next level being their friends.
Secrecy is also the cornerstone of all marketing channels. Social Media for instance works in a similar way to SEO, except they have secret voting methods rather than secret linking methods. You don't see major social media companies outing a rival's voting methods, as it would shine a torch on their own methods. Even outside of marketing, McDonalds probably worked out KFC's magic blend of herbs and spices decades ago, but it's not in their best interest to tell everybody.
Outing webspam helps an SEO blog to keep their UVs up and their VCs happy. It helps a failing newspaper to appear modern and edgy, whilst allowing the contributor to launch a protection racket off the back of another company's misery.
Do You Want SEOs to Seem More Professional?
How often do you see tier-1 public relations firms marketing themselves by smearing other PR firms?
The question is less whether black hat and webspam are a good thing or not, but if Google is the unbiased and benevolent instance who shall make the rules. Google is a business and persuits its very own interestes, since it is aware of its market power with a lot of arrogance, aggresivity and obviously double standards. That was also Aaron's point, but seomoz has been missing the point completly in the last time.
I expect an SEO portal/community to focus on how stuff actually works/can work, not to propagate how the monopolist does it want to work. It is their risk of doing business if they decide for an algorithm, not ours. It is our risk however, to decide whether to stick to the rules or not. And it's not only about ethics but has several practical implications...
Full Disclosure Required, Except From Us
On paid links Google claims to require machine AND human readable disclosure. Then on their own site they use an ad color background that literally fades to white on many monitors. Maybe it is legitimate that they are only able to fool some of the users some of the time. But some of their ad initiatives have 0 disclosure at all. None.
You wouldn't know by looking at it, but according to the WSJ it is: "Google lists booking links to the airlines as advertisements, but the company declined to comment on how much money it makes from the arrangement."
There is no disclosure that you are in a paid ad funnel until the very last click. And those who fail to pay are either unlisted, listed last, or have a broken booking process where their brand is arbitraged in an attempt to flip the click to somewhere else. According to Leocha, ?Google and the airlines have a sweetheart deal with each other, and the consumers are getting screwed.?
In the hotel market Google is also testing comparison ads & price ads.
Notice how little they care about relevancy so long as they keep the click on Google or are paid for the referral. They rank the car rental company Avis as a top Las Vegas hotel! And even the ad links that are sold off of that do not line up. Priceline pushes the Plazzo Luxury Suites & Booking.com pushes the Venitian.
Retarding Investment in the Search Ecosystem
What do you suppose the above behavior does to cash flow & multiples of websites in that vertical? Of course it contracts them & retards investment. Who wants to start a new hotel website at this point? What other verticals have investment held back by the fear of Google's eventual entry?
If you only had to manage competing against other market competitors & staying inside Google's editorial guidelines then investment isn't that difficult, but if you have to stay within Google's guidelines in the short term yet try to build a business that is sustainable even after Google enters & destroys the market it is far more difficult.
Skimming the Cream
At any time Google can enter any market and skim off the cream: "An independent study from Leads360 showed consumers using Google?s comparison ads converted better than any other lead provider."
Other affiliate networks which do not own the search channel have to fight through quality issues if they try to build similar scale.
A Self-serving Bias You Can Count On
When Google enters a market it might buy out a competitor, buy out a supplier, bundle, use predatory pricing, grant themselves superior search placement, adjust the relevancy algorithms and/or editorial guidelines, violate IP, scrape 3rd party content, work with sketchy advertisers & publishers to undermine competing business models, or any combination of the above.
They are rarely transparent with their interests when they enter a market. Almost everything is labeled as "a beta" and "just a test." They promise to "act appropriately" & you may not be aware of the steamroller until you are under it.
I recently read a blog post about how anyone could do the above & the opportunity is open to everyone. But the truth is, I can't state that something will become a relevancy signal that manipulates the search results in order to get buy in. Or, if I did something which actually had the same net effect, Google would likely chop my legs off for promoting a link scheme.
A Google spokesman said "applications that are installed without clear disclosure, that are hard to remove and that modify users' experiences in unexpected ways are bad for users and the Web as a whole."
The business model of "violate & then buy protection" has helped lead to a protection-racket styled marketplace in patents that makes the risk of innovation for smaller players so expensive that it drives them under.
Where Google has gained a dominant position in a marketplace they can begin misdirecting for profit. Let's say you link to your own location on Google Maps to drive traffic to Google & help your users locate your office. Well in some cases they then reciprocate by confusing users by putting an ad in your location bubble.
Once again, you are forced to buy your own brand unless you teach your customers (and prospective customers) to avoid Google products.
Sure I May Have Failed, But at Least That Failure Was Transparent...
If you are fully transparent against an arbitrary set of guidelines when the company that judges you also competes against you & brushes up against the limits of the DOJ & FTC then you might lose for no reason other than being transparent. And not only are you competing directly against Google, but the algorithms are biased toward certain players.
Today the Internet is an information highway where anybody ? no matter how large or small, how traditional or unconventional ? has equal access. But the phone and cable monopolies, who control almost all Internet access, want the power to choose who gets access to high-speed lanes and whose content gets seen first and fastest. They want to build a two-tiered system and block the on-ramps for those who can?t pay.
But when Google launched their Panda algorithm they did the same thing.
You might get smoked by a Panda update or have your accounts arbitrarily frozen while operating at a 7 out of 10 level, and then you see Ask is Google's biggest advertiser, their arbitrage gets a pass, & that feed even monetizes misspelled searches for Google's brand. ;)
For many businesses the unknown Panda risk is every bit as damaging as the great firewall of China. Each additional unknown kills x% of small new online businesses. If unemployment is high, companies are not hiring & the bar for self-employment is too high then the web stagnates.
If the old established corporate competition needs to be as good as you to compete then there is little risk to being transparent if the competition is doing nothing beyond following you around. But if the playing field is tilted and the competition only needs to be 5% as good as you are to beat you (and can easily come from behind to copy any success you have) then full on transparency brings much more risk than potential profits.
You Are the Ad
We are moving into a media world where the content becomes ads & even how people interact with the ads and content becomes a part of the ad.
Every time you view a page and click an ad (or even don't click an ad) you are feeding highly personal data back to Google. And they will use it as they wish. Here they are saying thousands of people like eBay, which is of course plenty reasonable, except for the fact they claim the people voted for that specific page rather than the site as a whole.
What's worse is that sometimes they will put your picture next to a listing and claim that YOU PERSONALLY voted for a specific page & use that to market that item to your friends and contacts. The problem with this is that:
even after you remove the vote for a site they still keep showing it
you may vote for site A & they will show your image as voting for site B
when they show your picture they claim you voted specifically for the page being advertised (even if that page is promoting a scam or something else you wouldn't endorse)
Once again, I will highlight that they use the votes against the wrong sites & pages and that they keep showing the votes even weeks after you remove them.
Where is the transparency in that deceptive crap?
Others Are Just as Bad, But Are Not Monopolies
But Aaron, you are just being hard on Google, why don't you ever mention Ask or Yahoo! or Bing?
Yahoo! offers a useless "buying guide" for fish tanks that is nothing more than a paid pointer to Overstock.com.
If you click on their coupons tab on that fish tanks search Yahoo! shows you coupons for tank tops, which is pretty idiotic.
Why is this Yahoo! Shopping & Yahoo! Deals product so ugly? They outsourced it years ago. So it is a non-product & thus the integration can't be anything but crappy.
Why do Yahoo! & Bing typically get a pass? They own a fairly low search marketshare. Missing traffic from either or both of those is certainly significant enough to be felt, however even when they are combined it is still less than half of what Google controls in most markets. Market leaders are expected to operate in less conflicted & less self-serving ways than also ran players in their market do. If Microsoft would have had 10% or 15% marketshare for their operating system then it is unlikely their browser bundling would have come under such scrutiny.
Transparency in The Real World
In the past I highlighted how every form of media is manipulated in Why Outing is Bad, but I thought it would be fun to run through some other markets and highlight how transparency often exists only as an illusion (to lure in punters so they can be rooked).
TrueCar aimed to make that market more transparent by giving consumers pricing data online to remove some of the asymmetrical advantage dealers have & makes the sales process smoother for consumers. How does the automotive market respond? Honda issued threats to their dealers & now TrueCar has a hate video ranking for their brand.
This nontransparency is not something new, but rather the way it has always been.
It exists at every level of society. Countriesspy on one another & companies may chose to show different views of the world to different markets.
News International?s leading profit centre, the News of the World, was dependent on a very ugly culture of lawbreaking, hacking and impunity. This freewheeling, ask-no-questions attitude spread to other parts of the organisation, such as the Times and the Sunday Times, both of which used have used illegal or unethical techniques. Even more troubling, when senior News International management were confronted with evidence of wrongdoing, the company made false statements and took actions which prevented key evidence from reaching the public domain.
Both cases involve News America Marketing, an obscure but lucrative division of the News Corporation that is a big player in the business of retail marketing, including newspaper coupon inserts and in-store promotions. The company has come under scrutiny for a pattern of conduct that includes below-cost pricing, paying customers not to do business with competitors and accusations of computer hacking.
Were The Robber Barons Transparent?
Going back into history it is sort of hard to pick a starting point (one can go to the spice trade & orders that are unsealed at sea, or likely earlier than that) but to pick a somewhat recent starting point, we could look at the railroads:
So how did unnecessary, inefficient railroads get built? Because of government subsidies. In short, the federal government paid to build the railroads through massive financing subsidies and also gave them ample land grants. The trick to building a railroad was not knowing anything about railroads or even about business; it was having friends in Washington who could give you the right financing and land subsidies.
Even then, the railroads lost money. Not only was there insufficient demand for their services, but they were run by people who were generally incompetent. (For one thing, they didn?t even know their own costs of doing business.) Yet the people who owned the railroads made fabulous amounts of money (of which Stanford University is one symbol). The main way to do this was simple. The people who controlled a railroad (generally by putting up very little of their own money, thanks to the government subsidies) would also wholly own a construction company. They would cause the railroad to overpay the construction company to build the railroad?in effect transferring wealth from railroad stockholders and creditors into their own pockets
What did the Robber Barons invest in? In large part government, media & educational institutions so that they could help "educate" society on how to behave much more civilly than they have.
Corporate Advocacy
There are tons of marketing campaigns designed to "educate" society about the impacts of various companies. BP now markets the gulf coast economy they plundered.
"Get the facts" styled campaigns are rarely about promoting a complete worldview.
Remember the $500 million fine for Google from them pushing ads selling overseas Viagra in the US? Now they promote scaremongering ads against fakes from filthy labs.
Coca-cola runs The Beverage Institute & has "doctors" highlight how healthy soda is.
At the same time, when Pepsi was sued over an alleged rat being in a can of Mountain Dew. Pepsi's defense claimed: "the mouse would have dissolved in the soda had it been in the can from the time of its bottling until the day the plaintiff drank it" turning the mouse into a 'jelly-like' substance. But don't worry folks, it's healthy. :D
It is hard to know what is in our food & those who label things as organic have to fill out more paperwork than those who manufacture frankenfood. Then there are the baseline chemicals sold as biodegradable which are not. ;)
One of the largest religious institutions was found to be associated with illegally selling off hundreds of thousands of babies (after telling the single mother that their newborn child died). This process was going on through the late 1980's!
This past holiday season Best Buy not only sold products they didn't have, but in many cases when they did have them they charged a rate higher than the one advertised unless you caught it & forced them to charge you the advertised price.
When looking at my credit card bill I saw a scammy $22.99 charge on it for a credit report I have never ordered. I looked up information about the "company" offering that service & the #1 result (with sitelinks) was my darn credit card company's website! They had to conduct a block on themselves, but if you don't notice it they will steal $23 a month until you die. ;)
Is Our Financial System Transparent?
When one looks at the field of finance it is story after story of deception, nontransparency & lawlessness. It is a constant reminder that there is no such thing as business ethics.
Bank of New York Mellon ripped off their clients with unsavory Forex rates: "As investigators sought to determine whether the bank overcharged clients to execute their currency trades, a senior BNY Mellon executive nicknamed "Rambo" urged traders not to tell clients how much money they made on trading, according to the informant."
A former Federal Reserve member writes about the Fed: "No matter the legalistic interpretation, the Fed is, working through the ECB, bailing out European banks and, indirectly, spendthrift European governments. It is difficult to count the number of things wrong with this arrangement."
"What?s happened is that, almost overnight, we?ve switched from democracy in real-property recording to oligarchy in real-property recording. There was no court case behind this, no statute from Congress or the state legislatures. It was accomplished in a private corporate decision. The banks just did it." - Christopher Peterson
The financial markets are becoming glorified crack houses: "Frankly, I am concerned that Wall Street is becoming little more than a glorified crack house. Day after day, the sole focus of Wall Street is on more sugar, stronger sugar, Big Bazookas of sugar, unlimited sugar, and anything that will get somebody to deliver the sugar faster. This is like offering a lollipop to quiet down a 2-year old throwing a tantrum, and expecting that the result will be fewer tantrums. What we have increasingly observed over the past decade is nothing but the gradual destruction of the ability of the financial markets to allocate capital for the benefit of future growth. By preventing the natural discipline of the markets to impose losses on poor stewards of capital, and to impose interest rates high enough to force debtors to allocate the capital usefully, the world's policy makers are increasingly wrecking the prospects for long-term economic growth."
Companies are often brought private, leveraged up on debt & have their pension programs destroyed to make "profits" for private equity investors: "Nowadays private-equity firms often spend hundreds of millions of their own money on an acquisition (BW -- Feb. 27). Just as often, though, they load up the companies with debt and use the money to pay themselves special dividends and other fees that allow them to profit even if the company itself struggles. Then the backers take the company public, often pocketing the lion's share of the offering."
Individuals who put in extra hours of work because they are sold on the promise of their options may also find thosedisappear: "Taking away the value of options that are vested means that the concept of vesting becomes bogus. It doesn't matter whether the employee understood if this was the deal or not, it's a scummy practice, and it's ultimately self-defeating (both for the company and the industry as a whole). Who would go to work for Skype (or any PE-backed company) in the future? "
Limitless fraud before the courts & dancing on the graves of the newly homeless: "Court records show that the firm angered state court judges for alleged false statements and filing suspect documents. Arthur Schack, a state court judge in Brooklyn, in a 2010 ruling said that pleadings by the Baum firm on behalf of HSBC Bank, a unit of London-based HSBC Holdings, in a foreclosure case were "so incredible, outrageous, ludicrous and disingenuous that they should have been authorized by the late Rod Serling, creator of the famous science-fiction television series, The Twilight Zone." ... The law firm said it would shut down after New York Times columnist Joe Nocera in November published photographs of a 2010 Baum firm Halloween party in which employees dressed up as homeless people. Another showed part of Baum's office decorated to look like a row of foreclosed houses."
That theft of physical property is ongoing: "Also announced over the weekend was the jaw-dropping, yet illuminating fact that the MF Global bankruptcy was fraudulently, nefariously and illegally drawn up as a Chapter 7 BK for a SECURITIES DEALER and NOT a commodity brokerage as it should have been. Look, MF Global was the second-largest non-bank FCM in the United States next to NewEdge which is the old FIMAT. If MF Global wasn?t an FCM, then there are no FCMs. Of course it was an FCM. It had $7.2 billion in customer seg funds as of August 31, 2011. And yet MF Global was immediately, from the get-go, put into Chapter 7 BK as a SECURITIES FIRM. This is fraud. MF Global?s BK should have OBVIOUSLY been established under Subchapter IV of the Chapter 7 code as a COMMODITY BROKERAGE."
And as banking criminals literally steal money, destroy lives & undermine the rule of law to grow their "profits" sleazeballs like Jamie Dimon think that the reason people hate them is envy.
The above makes no mention of helping Greece hide governmental debt, bid-rigging bribes in Jefferson County, robosigning bogus foreclosure documents, and a host of other crimes. But one thing in common with all the above crimes is this: no jailtime for the banksters.
Big banks represent the ultimate in concentrated economic power in today?s economies. They are able to resist all meaningful reform that could really change their compensation schemes. Their executives want to get all the upside while facing none of the true downside.
But capitalism without the prospect of failure is not any kind of market economy. We are running a large-scale, nontransparent, and dangerous government subsidy scheme for the benefit primarily of a very few, extremely wealthy people.
The actions of the financial cartel are both obvious & predictable. And the damage they do is felt worldwide:
Credit-financed economic booms, by turns in private then public credit as one ratchets up the other over a series of booms and busts, are as irresistible to politicians as hookers and maids. ... The failures of American FIRE Economy policies are behind the movements in Libya, Yemen, and Syria, as reflation measures, from quantitative easing to currency depreciation, steal purchasing power from low income families world wide, acting as the most regressive tax imaginable. Simmering hatreds are exacerbated by the developing global crisis over oil supplies and costs. ... The so-called debate about debt ceilings, spending cuts, and entitlements reductions is a red herring. The public debt crisis arose from the 2007 - 2008 private credit market crisis, not the government liabilities that have been building for decades. The mistake of both the left and the right is thinking that we can escape an output gap without facing up to the politically unpopular task of demanding that creditors take a loss on loans taken out during the credit bubble era.
A creditor that makes bad loans deserves to go out of business. Their outsized compensation can't be justified unless they are also made to eat their losses. But rather than holding them accountable for their own actions, societies the world overabsorb that pain.
"Fascism should more appropriately be called Corporatism because it is a merger of state and corporate power"- Benito Mussolini
Money is a human construct. The fact that our money is now backed by nothing more than our collective future ability to "produce" relegates us to that of slaves.
Money=paper=blood hours.
Blood hours are a finite measure. Heartbeats.
What's in your wallet? Is it the new debt slavery card: "A personal bankruptcy is supposed to cut borrowers loose from lenders and debt collectors, but Capital One Financial Corp.?one of the nation's largest credit-card issuers?sometimes doesn't want to let go."
After dropping his younger daughter at school, Octa walked into Citibank?s credit card collection department on the fifth floor of the Jamsostek tower just after 10 a.m. Four hours later, he left the 25-story building slumped motionless in a wheelchair -- a victim of what police allege was a violent assault by debt collectors. Driven to a nearby hospital in a Citibank car, Octa was pronounced dead on arrival.
Unfortunately, even if you stay out of debt, you are forced to support banking scams:
before being bailed out by governments, banks had never made any return in their history, assuming that their assets are properly marked to market. Nor should they produce any return in the long run, as their business model remains identical to what it was before, with only cosmetic modifications concerning trading risks.
So the facts are clear. But, as individual taxpayers, we are helpless, because we do not control outcomes, owing to the concerted efforts of lobbyists, or, worse, economic policymakers. Our subsidizing of bank managers and executives is completely involuntary.
The way the banks make money now is by hiding their losers off balance-sheet, or by forcing them on the taxpayers, and after having themselves declared "systemically important," adjusting their on balance-sheet exposures accordingly, crashing the system and cashing out on their leveraged derivative bets, also at the taxpayers' expense.
In real life, if there is such a thing anymore, all of the major banks are arguably insolvent. So, in reality, they're not making any money at all, they are merely having it transferred to them by their political operatives in Congress and the Federal Reserve Bank. This, after all, is the modern purpose of the Congress, and has always been the purpose of the Federal Reserve System.
government and banks are stuck together like a couple of dogs screwing and we don't know which is on top. Here, Republicans need government to finance war and Democrats need it to finance social programs. Both need it to finance both, as that is how government attempts to maintain power and influence over the people this day and time.
When Senate Democrats finally brokered a compromise over the proposed health-care law, a group of hedge funds were let in on the deal, learning details hours before a public announcement on Dec. 8, 2009.
The news was potentially worth millions of dollars to the investors, though none would publicly divulge how they used the information. They belong to a select group who pay for early, firsthand reports on Capitol Hill.
Since most money comes into circulation as debt (and due to the compounding nature of debt interest), if those at the top are not allowed to fail then those at the bottom will fall hard:
In the past, periods dominated by virtual credit money have also been periods where there have been social protections for debtors. Once you recognize that money is just a social construct, a credit, an IOU, then first of all what is to stop people from generating it endlessly? And how do you prevent the poor from falling into debt traps and becoming effectively enslaved to the rich? That?s why you had Mesopotamian clean slates, Biblical Jubilees, Medieval laws against usury in both Christianity and Islam and so on and so forth.
Since antiquity the worst-case scenario that everyone felt would lead to total social breakdown was a major debt crisis; ordinary people would become so indebted to the top one or two percent of the population that they would start selling family members into slavery, or eventually, even themselves.
Well, what happened this time around? Instead of creating some sort of overarching institution to protect debtors, they create these grandiose, world-scale institutions like the IMF or S&P to protect creditors. They essentially declare (in defiance of all traditional economic logic) that no debtor should ever be allowed to default. Needless to say the result is catastrophic. We are experiencing something that to me, at least, looks exactly like what the ancients were most afraid of: a population of debtors skating at the edge of disaster.
And, I might add, if Aristotle were around today, I very much doubt he would think that the distinction between renting yourself or members of your family out to work and selling yourself or members of your family to work was more than a legal nicety. He?d probably conclude that most Americans were, for all intents and purposes, slaves. ... Clearly any pretence that markets maintain themselves, that debts always have to be honored, went by the boards in 2008. That?s one of the reasons I think you see the beginnings of a reaction in a remarkably similar form to what we saw during the heyday of the ?Third World debt crisis? ? what got called, rather weirdly, the ?anti-globalization movement?. This movement called for genuine democracy and actually tried to practice forms of direct, horizontal democracy. In the face of this there was the insidious alliance between financial elites and global bureaucrats (whether the IMF, World Bank, WTO, now EU, or what-have-you).
Of course there are "opposition research" hacks willing to dig up dirt on anyone with wide reach who opposes the state-sponsored fraud: "It will be vital,? the memo says, ?to understand who is funding it and what their backgrounds and motives are. If we can show that they have the same cynical motivation as a political opponent it will undermine their credibility in a profound way.?
In 2004 the FBI warned that there was an "epidemic" of mortgage fraud and that it would create a crisis.
"My administration is the only thing between you and the pitchforks," the president told them.
And, in spite of the FBI highlighting the massive mortgage fraud, and the above quote, the president (who is a horrible human being) aims to keep the population misinformed & ignorant, publicly stating that what Wall St did wasn't illegal!
this is how the much-lauded "freedom of the press" myth in the US actually works. If you perform the job of an actual journalist, telling truth to power, forget about attending press conferences at the White House, Pentagon or State Department. You won't even be admitted in the building.
The people who most heavily rely on pseudonyms in online spaces are those who are most marginalized by systems of power. ?Real names? policies aren?t empowering; they?re an authoritarian assertion of power over vulnerable people.
