Archive
Day 2: Big Data Innovation Summit 2014 #DataWest14
.
Hello again big data fans – from where I’ve learned the San Francisco 49’ers will be playing their 2014 NFL season at Levi’s Stadium… Santa Clara!
(BTW, the stadium – from what I could see – is beautiful! I’m a big NFL fan, and there’s now another reason to come to the San Jose area, other than all the cloud / big data conferences.)
Got a lot of great feedback on yesterday’s “Day 1” post of the summit, so here are some observations from the final day of the conference.
- Yahoo’s Duru Ahanotu spoke through driving efficiency in how data teams are organized, going through the permutations of generalists vs specialists and centralized vs de-centralized, and how to best address teams in each model.
. - PayPal’s Moises Nascimento (who is a very captivating speaker) drove the point home, that though we are now adopting many of the new data technologies like Hadoop and NoSQL, most of our existing data sources and toolsets still provide value – so there is value in leveraging ALL data sources.
. - Moises also made a point of highlighting that data manipulation is best handled at the SYSTEM level, while data analysis is better managed at the ENTERPRISE level
. - In HP’s discussion, they introduced the concept of the GEOBYTE – 10^30 bytes, a size of data that the human race is expected to hit in the next few years.
To provide context on the magnitude of a GEOBYTE (10^30 bytes), there is estimated to only be 10^19 GRAINS OF SAND ON THE EARTH. Think about that for a second.
- The team also highlighted their view on “Big BI” vs “Big Data”
- Big BI – same types of analysis but on more data; more batch processing; results that were not easily actionable
- Big Data – joining datasets that have not been previously joined, near real time analysis, action oriented results
.
- I thought Ancestry.com had one of the best sessions of the event, as they went deep into the GERMLINE algorithm that was the foundation of their business technology, and how they had to create jermline (now with a “j”) based on Hadoop / HDFS to create a SCALABLE matching engine. As we all know, SCALE matters. The performance and speed benchmarks between the “G” project and the “j” project were mindblowing.
. - Finally, sat in on the Netflix session – in addition to being a big fan of Netflix, as both a consumer and a tech observer, I’ve always been impressed with the way Netflix has evolved their business, and continues to do so. In this session, they went into great detail on their use of the Amazon cloud services, and their open source projects as a layer above to enhance functionality and deploy features. Topics touched on included red / black deployment to allow ease of features into production, and the importance of graceful degradation, so that a failure can be less of a catastrophic event for the end user.
.- One very telling statement is really a commentary on the value of use and participation in the open source process – Netflix was clear that they see value in being an open source contributor / leader is that it preserves the future of their systems – rather than sitting back and letting the industry decide their direction with tools and tech, Netflix uses open source to help drive and lead the industry to where they see value.
.
- One very telling statement is really a commentary on the value of use and participation in the open source process – Netflix was clear that they see value in being an open source contributor / leader is that it preserves the future of their systems – rather than sitting back and letting the industry decide their direction with tools and tech, Netflix uses open source to help drive and lead the industry to where they see value.
- (I did resist the urge to ask the Netflix presenter when the next season of “House of Cards” would come out. 🙂 )
.
One of the frequent questions that came up at the Dell booth was “what is Dell doing in big data?”
The answer? Actually… quite a bit, and for quite a while.
Between the Dell Apache Hadoop HW+SW+Services Solution, the Toad BI suite, the Kitenga analytics toolsets, and our growing HPC business, Dell has been a part of this movement since its early days. I’d recommend you drop us a line at Hadoop@Dell.com or visit us at http://www.Dell.com/Hadoop to learn more.
If you were out at the show this week, be sure to leave a comment on your thoughts as well.
Hope everyone has safe trips home, and we’ll see you at the next big data get-together!
Until next time,
JBG
@jbgeorge
It’s OpenStack Foundation Election Time!
What is your relationship to OpenStack, and why is its success important to you? What would you say is your biggest contribution to OpenStack’s success to date?
I believe OpenStack represents a trend that service providers and enterprise IT are making to deeper community collaboration on new technologies and practices, and I will continue to drive the initiative to make my customers and the community successful in a very real-world meaningful way.
Describe your experience with other non profits or serving as a board member. How does your experience prepare you for the role of a board member?
What do you see as the Board’s role in OpenStack’s success?
What do you think the top priority of the Board should be in 2014?
1. Clarify the definition of OpenStack – what is core, what is compliant, and what is not.
2. Understand where the strategic opportunities lie for OpenStack as a technology, and clear the path to ensure OpenStack gets there.
3. Fully enable any and every new entrant to OpenStack in a real way – developers, implementers, and users – with the right level of documentation, tools, community support, and vendor support.
.
Thanks, and appreciate your nomination to represent the OpenStack Foundation in 2014!
Until next time,
JOSEPH
@jbgeorge
Rock The [OpenStack] Vote!
.
Well its that time of the year again!
(I guess that’s fairly a open ended statement – I could be talking about the beginning of the school year, the start of football season, or the summer solstice.)
I’m talking about getting your votes in for sessions at the OpenStack Summit coming up in Hong Kong this November!
If you’re a member of the OpenStack community, you should have received a note this past week requesting your help to select which sessions should be represented at the Design Summit and User Conference this fall.
Now, let me be clear – this should not be a popularity contest on presenters (like me) or vendors (like Dell, the company I work for), but rather where you see need for certain experts to discuss a topic that is important to the OpenStack development community or to the OpenStack user community.
Yours truly has submitted a few sessions as well for your consideration – check it out:
- Remain Calm and Deploy On! (or How the Crowbar Community Is Innovating for Success with OpenStack)
In this session, I’m planning to highlight the importance of deployment technologies in implementing OpenStack as a cloud option, and how we’ve approached it by developing our own open source project, Crowbar. I’ll be joined by Crowbar community contributors Intel (who are working on Crowbar capabilities for Intel Hadoop and Intel TXT security) and SUSE (who have incorporated a SUSE skinned version of Crowbar into their SUSE Cloud product). I expect it will be a great interactive session with the goal of educating the audience on how Crowbar can enable them to get going faster with OpenStack.
- Enterprise Hypervisors: How Three Companies Are Making OpenStack with Hyper-V a Reality
Earlier this year, we announced Dell taking an active role in bringing true Hyper-V hypervisor support to OpenStack. To provide an update on progress there, I’m proposing a topic to present jointly with peers at SUSE, who we’ve partnered with on the Dell SUSE Cloud Solution, powered by OpenStack, and Cloudbase, who have been pioneers in Hyper-V enablement in OpenStack, to talk through how customers can implement a Hyper-V based OpenStack solution using technology from all three companies. There has been solid work to date, including Crowbar integration, so I expect this will be a lively one!
- Build in OpenStack Security with Crowbar and Intel TXT
I can’t tell you how excited I am about how the Crowbar project has evolved over the years. It started as an answer to the problem of “how do I deploy OpenStack on bare metal?” but has now emerged as a broad software platform for innovation covering cloud, hadoop, and other use cases. One telltale sign of progress to me is how others are leveraging Crowbar, and cloud security is definitely an interesting area. This session is one where I’ll present with my friends at Intel to talk through how Intel has developed Crowbar functionality for their Intel TXT secure resource pool solution. Expect a lot of Q&A on this one.
And that’s it!
Appreciate you voting with the community’s best interest in mind!
And you can learn more about the coming OpenStack Summit here – http://www.openstack.org/summit/openstack-summit-hong-kong-2013/
Until next time!
JBG
@jbgeorge
NOW HIRING: Cloud and Big Data Solution Marketing Rockstars
.
As Dell (the company that I work for) continues to service customers in all facets of OpenStack and Hadoop implementations, we are beginning another season of growth on the Revolutionary Solutions team.
The Dell Revolutionary Solutions Team delivers the Dell OpenStack-Powered Cloud Solution and the Dell Apache Hadoop Solution, leads the Crowbar open source project, and manages the Emerging Solutions Ecosystem Partner Program that includes a number of key partners such as Suse, Inktank, Cloudera, Datameer, and Pentaho.
We are looking for a variety of engineers and presales teams, but I will focus on the product management and marketing roles in this post.
Technical Product Managers – Product managers to be technical SMEs (roadmaps, requirements, etc) on partner products in the cloud and big data spaces, most notably OpenStack and Hadoop, but could also be focused on other emerging solutions spaces – Link to Job Posting
- Product Marketing Managers – Marketing experts to own and lead go-to-market strategy and deliverables in the cloud and big data spaces (marketing strategy, sales enablement, etc). Again, this would certainly cover our OpenStack and Hadoop solutions today, but could also focus on future emerging solutions spaces. – Link to Job Posting
- Open Source Community Manager / Evangelist – Community oriented professionals with strong networks, strong social media presence, and an ability to bring collaborators and customers together to work on common goals – Link to Job Posting
- Marketing Directors – Experienced people managers to drive business objectives, product vision, and go-to-market strategy, specifically in the areas of Product Management and Product Marketing – Link to Job Posting
In our experience, the best candidates
- have a track record of ownership
- have a techincal background
- are experienced in their discipline
- are participants in cloud, big data, virtualization, or similar emerging technologies
Pass it on to a friend or apply yourself – I look forward to hearing from you!
Until next time,
JBGeorge
@jbgeorge
Dell Cloud News: Hyper-V for OpenStack, Public Cloud Partner Program
.
Two pieces of important cloud news coming out of Dell (the company I work for) today:
- Dell to Enable Hyper-V and Windows Server 2012 Support for OpenStack
Dell today announced it will enable Microsoft Windows Server Hyper-V as a viable hypervisor choice for the OpenStack cloud platform. This development, which is the first instance of a leading technology vendor enabling Windows Server Hyper-V hypervisor on OpenStack for private clouds, will give customers additional flexibility and choice to run OpenStack workloads within their existing Windows Server environments.
More info here.
- Dell to Deliver Public Cloud through Partner Ecosystem
Dell is launching the Dell Cloud Partner Program to deliver public cloud Infrastructure as a Service (IaaS) through an ecosystem of partners. Acting as a single-source supplier, Dell will offer customers a choice of vendors and technology, freedom from lock-in to a single platform or pricing model and a central point of solution integration and control. Sales of Dell’s current in-house multi-tenant public cloud IaaS will be discontinued in the U.S. in favor of best-in-class partner offerings.
More info here.
Both of these announcements highlight key tenets for our cloud strategy.
- First and foremost, our customers come first when it comes to new products, solutions, and services – they are the most important element in enabling the vendor lanscape understand where the priorities should be.
- We will continue to collaborate and learn from our customers as we develop products, solutions, and services in the cloud space. It is part of our DNA – plain and simple.
- Though our tactics evolve, our commitment to enabling our customers with cloud technology remains constant. Customers are finding success in cloud when partnering with Dell, and we’ll continue to keep that our mission.
- Specifically with OpenStack, our commitment to enabling the innovative cloud technology and community remains as solid as ever. We have been vocal advocates since Day 1 (something no other hardware solutions vendor can claim), and we have no intentions of slowing down.
From the Data Center Solutions (DCS) team, who have built and enabled some of the biggest public clouds in the world, to the Dell Revolutionary Solutions Team, who have been early entrants into the OpenStack and Hadoop spaces, and to Dell’s open source community in Crowbar, we’ve proven our commitment to innovation and customer success.
That is what we are about.
And don’t expect that to ever change.
Until next time,
JBGeorge
@jbgeorge
ONE MILLION: Dell Data Center Solutions (DCS) Ships Millionth Server
.
The team at Dell (the company I work for) celebrated a huge milestone last week…
The Data Center Solutions group (aka DCS) officially shipped their millionth cloud server!
As the director of DCS marketing, Drew Schulke, pointed out, DCS’s influence is all around you – “If you used a search engine, updated your status via social media, or generated a map on the internet to get from ‘point A’ to ‘point B’ today, there is a good chance that a DCS server made that possible.” (You can read Drew’s entire blog here.)
As many of you know, I lead a team of product managers and strategists on the Dell Revolutionary Cloud and Big Data team, who focus on areas such as OpenStack and Hadoop, who deliver the Dell Crowbar software framework, and lead the Crowbar open source community.
So what does DCS have to do with our OpenStack / Hadoop / Crowbar team?
Actually quite a bit.
DCS set out to meet the needs of the hyperscale customer, and as it turns out, most of those customers are looking at cutting edge technology trends like OpenStack, Hadoop, and open source toolsets.
In fact, our solutions feature PowerEdge C servers, the density optimized server line that was born out of the work done by DCS, and are being run by our solutions customers on a regular basis as they stand up cloud and big data environments.
So by pulling together integrated HW+SW+Services solutions around OpenStack and Hadoop, leveraging innovative Dell IP like Crowbar and the unique advancements coming out of the DCS group, we’re able to make our customers even more successful – which is what its all about.
Win-win-win!
It’s a great milestone for the innovative DCS team – join me in celebrating this momentus milestone!
Until next time,
JOSEPH
@jbgeorge
More info:
NOW HIRING: Dell’s Revolutionary Cloud and Big Data Team Expands
.
We’re growing!
The Revolutionary Cloud and Big Data Team at Dell (the company I work for) is looking to expand our team of rockstars, so we’re putting the word out. Specifically we’re looking for architects, engineers, developers, and I’m looking to hire a few more senior product managers to join my team of subject matter experts.
Just for context, we’re the team that has taken to market the Dell OpenStack-Powered Cloud Solution, the Dell Apache Hadoop Solution, and the Dell Crowbar software framework and open source project.
And if you’re a rockstar in any of those spaces, we’d like to talk to you.
SPOILER ALERT – If you’re interested in talking to us about a technical spot on our team, you can email us your info and resume at OpenStack@Dell.com or Hadoop@Dell.com.
What is this team about?
A few years ago, the Dell Data Center Solutions team came into being with a mission of servicing the biggest hyperscale environments in the world, which included many of the market’s top cloud providers. It has succeeded in its mission in dominating the density optimized space (check out more on that here), and in fact, just shipped it’s ONE MILLIONTH SERVER.
An extension of DCS’s mission soon became clear – as many customers were looking to accelerate into spaces like cloud and big data, providing them integrated solutions would ease their implementation of these technologies. And so our Revolutionary Cloud and Big Data Solutions team was born – to deliver integrated solutions based on cutting edge technologies like OpenStack and Hadoop (and more), as well as innovative Dell projects like Crowbar, in an effort to enable customers to grow and thrive in their businesses with our products, innovation, and expertise.
Who are we?
The team at Dell is made up of a number of people, like myself, that you’d recognize from OpenStack and Hadoop circles – folks like Rob Hirschfeld, Greg Althaus, Kamesh Pemmaraju, and others. We all come from a variety of backgrounds – some from big companies in the technology spaces and many from startups – we happen to have quite a few entreprenuers on our team! And we try to service our customers in the best way possible – agile development processes, open source friendly, community oriented, etc.
What are we trying to do?
Our mission is to develop and deliver HW+SW+Services solutions to market that will enable our customers to be successful. Clear and simple.
Here’s a sampling of what our team has done over the course of our existence:
- The first hardware solutions vendor to support OpenStack
- Released the first HW+SW+Services OpenStack solution to market – the Dell OpenStack-Powered Cloud Solution
- Launch of open source project “Crowbar” to fill the void of an automated bare metal OpenStack provisioner
- Released HW+SW+Services Apache Hadoop solution to market – the Dell Apache Hadoop Solution
- Launch of the Emerging Solutions Ecosystem Partner Program to enable our customers by incorporating some of our best in breed partner technologies into our solutions, which includes Datameer, Pentaho, enStratus, Mirantis, and Canonical, with more to come
- Launch of the Emerging Solutions Platform Partner Program to enable our customers by delivering solutions focused on specific workloads and target markets
In addition, we’re big believers in the community – we regularly hold hackfests to help move these communities forward, lead community meetups in Austin and Boston working with other key vendors that co-sponsor with us (you may be surprised), are regularly active in IRC, skype discussions, conference breakout sessions, and more.
It’s a fast-paced, customer focused, ever evolving group and its a great place to deliver tanglible, difference making solutions to customers.
It’s not for the faint of heart, but it’s DEFINITELY for the mover and shaker.
Who we want to hear from
We’re looking to expand in a number of areas, but specifically we’re looking for technical talent
- Developers / QA
- Technical Product Managers and Strategists
- Architects and Technical Leads
If I’ve piqued your interest, drop me a note and your resume at OpenStack@Dell.com.
Look forward to hearing from cloud / big data / open source rockstars.
Until next time,
JOSEPH
@jbgeorge
Highlights from the 2012 Hadoop World
.
Had a great time at last week’s Hadoop World, so wanted to write up a few of my thoughts from the event.
- This year’s Hadoop World was the best attended to date – I believe I heard the attendee number to be at 2500 vs 1400 last year! It’s great to see this kind of growth among the community considering there were only 500 attendees just four years ago.
- In some similarities to what I’m seeing in the OpenStack community, this conference seemed to boast more from the “user” ranks as opposed to just developers as in the recent past. It speaks volumes to the general adoption that Hadoop is seeing in the market.
- Dell, the company I work for, and our Ecosystem Partner Datameer hosted a networking event for a number of folks at Hadoop World at the prestigious Circo NYC restaurant – great food and a great time with some innovative Hadoop implementers. Got to really get indepth how real people are implementing Hadoop in their enviornments today. Appreciate those that took the time out to attend, and for those who missed out, see you next time!
- Cloudera announced their beta project called “Impala”, which allows users to perform real-time queries of their data, a feature that a number of Hadoop users have been anticipating. According to Cloudera, Impala can process queries up to 30 times faster than Hive / MapReduce – very cool, and I look forward to checking it out.
- Finally, Dell made an announcement about our donation of “Zinc”, an ARM-based server concept to the Apache Software Foundation, with support from our partner, Calxeda, where we see ARM infrastructures as an interesting technology for Hadoop environments. The donation includes hosting and technical support for the Apache community. and we’re hosting the server concept at an Austin-based co-location. The Apache Hadoop project has actually performed more than a dozen builds within the first 24 hours of the servers’ deployment. (You can check out the full press release here to learn more.)
All in all, Hadoop World is another hit! It was a great event overall and I look forward to next year’s conference.
To learn more about the Dell Apache Hadoop Solution and more about what Dell is doing in this space, visit us at www.Dell.com/Hadoop.
And if you want to chat about how Dell can help you with your Hadoop initiative, drop me an email at Hadoop@Dell.com.
Until next time,
JOSEPH
@jbgeorge
Dell Cloud Happenings This Week…
.
Just wanted to drop a quick blog to provide a central area on what events Dell has going on in the cloud space this week.
Here we go…
WHIR Webinar – Wed, June 20th
What: Dell / Intel / Morph Labs WHIR Webinar
Title: “Proven Innovation to Reduce Data Center OpEx by 40%”
When: Wednesday, June 20, 2012 2:00 PM – 3:00 PM EDT
Who: Deania Davidson (Dell), Naveen Bohra (Intel), Winston Damarillo (Morphlabs)
More Info: https://www2.gotomeeting.com/register/506707474
Boston OpenStack Meetup – Thu, June 21st
What: Dell and Red Hat co-sponsor this month’s Boston OpenStack Meetup
When: Thursday, June 21, 2012, from 6:30 – 9:30PM
Where: The auditorium located at 85 Wells Avenue Newton, MA
Agenda: OpenStack Swift, Quantum
More Info: http://www.meetup.com/Openstack-Boston/events/67737262/
Austin OpenStack Meetup – Thu, June 21st
What: Dell and Opscode co-sponsor this month’s Austin OpenStack Meetup
When: Thursday, June 21, 2012, from 6:30 – 9:30PM
Where: The Austin Tech Ranch
Agenda: OpenStack Foundation with Foundation guest speakers Mark Collier, Jonathan Bryce, and Lauren Sell
More Info: http://www.meetup.com/OpenStack-Austin/events/67989692/
Look forward to seeing a big turnout at each of these! See you there.
Until next time,
JBGeorge
@jbgeorge
THIS JUST IN: Dell Announces ARM Server Ecosystem and Acceleration Programs
.
If you’ve followed some of the technology advances in the processor space, you’ve no doubt heard of the ARM architecture. We’ve seen ARM processors in a number of client devices, but they’ve not been widely adopted for server use due to additional feature needs, performance, and limited software ecosystem.
Well, today, Dell (the company I work for) announced some of the work we are doing behind ARM and ARM-based servers.
ARM, which stands for “advanced RISC machine,” is a 32-bit RISC instruction set architecture developed by ARM Holdings. In the server context, it can allow systems to be deployed at the chip level to reduce space, power consumption and cost.
Dell has been testing with ARM since 2010, and has been working with customers to understand how they could benefit from the ARM architecture, as well as what their expectations were regarding ARM-based servers.
Dell “Copper” ARM-based server
Today, we announced development of “Copper”, an ARM-based microserver, optimized for the current maturity of the ARM server market, which is primarily focused on test / dev and ARM-based technology to test and optimize code. And for this predominant use case, the Copper server is a great fit in terms of size and costwith its lightweight design, low-power-consumption and excellent density.
Dell’s Copper server is specifically designed for this market, with a small acquisition size and price, lower power consumption, and ease of use, and if you’ve followed our open source solution to date, you know that enabling open source development is important to us.
Enabling customers and the ecosystem
Testing to date has found compelling performance per dollar and performance per watt advantages for workloads like LAMP stack based web front ends and Hadoop applications. In that vein, we’ve partnered with TACC, the Texas Advanced Computing Center to help work through workloads, use cases, etc. We are also working with key open source partners like Canonical and Cloudera to help drive this space as well.
And for those who follow our Cloud and Big Data solutions (like the Dell OpenStack-Powered Cloud Solutions, the Dell Cloudera Hadoop Solution, and Crowbar), you’ll be happy to know what our team intends to enable ARM in Crowbar as well. It has proven to be a great tool in deploying our solutions on bare metal and managing the overall solutions that we see a great fit for it in the ARM use case.
We’re obviously very excited about this announcement, so I’d welcome you to check out the links on the ARM / Copper announcement at the end of this blog and in the video below.
Until next time,
JBGeorge
@jbgeorge
More info:
- Learn more about what Dell is doing with ARM and the new “Copper Server” – www.Dell.com/ARMserver
- Learn more about ARM (Wikipedia)
- Learn more about Dell and Hadoop – www.Dell.com/Hadoop
- Learn more about Dell Crowbar – www.Dell.com/Crowbar
