What is Datrium ControlShift?

Recently, Datrium has made a series of announcements, one being the introduction of our new product called ControlShift.

Following on from my previous post, ‘What is Datrium DVX?‘ and ‘What is Datriun CloudDVX?‘ I’ll explain in simple English what CloudShift is and highlight some of my favorite features.

Datrium ControlShift

ControlShift is a cloud-based, workload, and disaster recovery (DR) orchestration service. Using DR Plans (run-books), workloads, and data to be easily moved and/or recovered between multiple on-premises environments and/or VMware Cloud on AWS.


Datrium ControlShift

Like CloudDVX, ControlShift is a SaaS service managed by Datrium running in AWS. Customers do not need to install/manage/upgrade additional software, this is all managed by Datrium. For DVX customers, once ControlShift is enabled, it is seamlessly integrated with the Datrium DVX vCenter Plugin, shown below.

ControlShift Button

For non-DVX customers, ControlShift is accessed via a unique customer URL. Once logged into ControlShift, we are presented with the ControlShift Dashboard

Datrium ControlShift Dashboard

Within the CloudShift Dashboard, we can see an overview of the whole Datrium environment. We can see all of our vSphere Protected Sites, our DVX systems, our CloudDVX instance and if deployed, our VMware Cloud on AWS SDDC. The arrows between the sites in the Topology diagram illustrate the direction of replicated data between sites. In this example, all sites are replicating to CloudDVX. However, replication between on-premises is available when using Datrium DVX. Having data replication between sites and the cloud allows us to be able to quickly move workloads between sites or bring up workloads in the event of a site failure.

ControlShift Dashboard
Read the rest of this entry »

Why Datrium’s Automatrix Platform Is “Too Good To Be True!”

During my time at Datrium, I’ve been hearing more and more CIO’s and Head’s of IT say the following line whilst our Sales teams are pitching the Datrium Automatrix Platform.

This sounds too good to be true!

The reason why Automatrix is classed as “too good to be true” is because of what we as an IT industry have become accustomed to. We accept and expect IT systems to be complex to manage, maintain and require training to operate. It’s a given that you will need to use multiple vendor solutions in order to meet your business requirements.

So when a solution is presented to us that contradicts our many years of IT experience, we immediately pass it off as “too good to be true”, even if in fact, it is true!

Take for example VMware. We all know and love VMware and their products. However, it didn’t always use to be this way. Back in the early early days of VMware, adoption of VMware Server, as it was called then, was almost limited to use as a Disaster Recovery option as it wasn’t deemed something that could be used in production. Not because it wasn’t production-ready, but because it was “too good to be true” and no one believed that it could do what VMware said it could do.

It’s frustrating when you know first-hand how good something is, but other people don’t seem to want to listen to what you are telling them, especially when you know that they will benefit from it.

I recently read a fantastic article from James Clear; Why Don’t Facts Change Our Minds and I think much of what James talks about in his article relates to what I am seeing within the industry.

Truth and accuracy are not the only things that matter to the human mind. Humans also seem to have a deep desire to belong. Humans are herd animals. We want to fit in, to bond with others, and to earn the respect and approval of our peers. We don’t always believe things because they are correct. Sometimes we believe things because they make us look good to the people we care about.

If a brain anticipates that it will be rewarded for adopting a particular belief, it’s perfectly happy to do so, and doesn’t much care where the reward comes from — whether it’s pragmatic (better outcomes resulting from better decisions), social (better treatment from one’s peers), or some mix of the two.”

I think because of what James talks about, IT folk find it difficult to go against the status quo, even if a new product can be highly beneficial to a business. And I get it. We all want to fit in and be accepted by others, even if it holds many of us back.

its-better-to-walk-alone-than-with-a-crowd-going-in-the-wrong-direction

Summary

During my time in the industry, I’ve actually found that going against the crowd, whilst as difficult as it is, can often bring us the most success. Not everything works out, but when it does, it’s massive and usually a game-changer for you and your company.

So if you see/hear something that you think “This is too good to be true!”, don’t just push it aside. It could actually be true and you are going miss out on all of the value you will get from it. Take the pragmatic approach. Dig deeper. This could be a diamond in the rough.

Datrium is not “too good to be true!”. It is actually true! We can prove it. If you’ll let us of course.

Here are some fun (non-IT) examples of where I wished I had taken the pragmatic approach rather than listening to my social circles.

  • Cold Brew Coffee – Growing up in England, Coffee was always hot. If it was cold, you’d pour it away. Now I can’t get enough of the stuff!
  • Tempur-Pedic Mattress – Quite possibly one of the best purchases I ever made. They cost an arm and a leg, but OMG it’s soo comfortable. Even though TV commercials told me how good they were, I thought they were “Too good to be true”. Then I had a hotel room with one in and I’ve never looked back.
  • Yeti Tumbler – How good can a cup really be? Do I really need my drink to be kept cold/hot? I thought not. I got one as a gift for my birthday and I’ve pretty much used it every day since. I’ve even brought one for other people I know who’d love it, but like me, thought it was “Too good to be true”.

 

 

 

 

Why I’ve Hardly Blogged Over The Past Year, And It’s All Datrium’s Fault!

Keeping It SimpleLately, I’ve had a few people ask me “How come you aren’t blogging much anymore?”  My typical response to that question is usually “I’ve not really had much to post about!” Which, when I think about it, really doesn’t make sense. I joined Datrium a year ago, and since joining, it’s been a near-vertical learning curve, working on some ground-breaking technologies. So why don’t I feel like I have anything to blog about?

Well, over the past 10 years, my main reason for blogging was to share knowledge with others around, usually, complex technical issues and configurations. Some examples from the past few years:

So, this leads me to why I’ve not really posted much since joining at Datrium.

Why blame Datrium?

Read the rest of this entry »

vMotion Error – Failed to receive migration

I recently ran into a situation, when after adding a new ESXi Host into a vSphere Cluster that will be used for Nested ESXi, I was unable to vMotion live VM’s onto the new Host. The error message I was getting was ‘Failed to receive migration’

A quick Google search didn’t yield any results, so I had to resort to reading the logs. In the Virtual Machine log file (vmware.log) I noticed this error message: (Scroll to the right)

2019-01-10T20:31:06.254Z| vmx| I125: Msg_Post: Error
2019-01-10T20:31:06.254Z| vmx| I125: [msg.cpuid.vhv.enablemismatch] Configuration mismatch: The virtual machine cannot be restored because the snapshot was taken with VHV enabled. To restore, set vhv.enable to true.

Doing a quick search of the term: vhv.enable showed me that this is required to be set on hosts that are being used for Nested ESXi. Thanks William Lam (https://www.virtuallyghetto.com/2012/08/how-to-enable-nested-esxi-other.html)

So I ran the following command on the new ESXi Host:

echo 'vhv.enable = "TRUE"' >> /etc/vmware/config

After that configuration was added to the config file, vMotions began to function as expected.

Quick And Easy Replication For VDI Golden Images

Continuing on from my previous post; Backup, Restore And Replicate App Volumes, AppStacks And Writable Volumes another large challenge I faced running a Global Enterprise VDI environment was managing the Golden Images.

Replicating VDI Golden Images

The Challenge of Golden Image Replication

For those of you who might not be familiar with VDI environments, Golden Images are the virtual machines that virtual desktop pools are created from. If you need to add an application or make an OS customization for all of your end users, typically you will make the change in the Golden Image and then push that image out to the virtual desktops.

When a VDI environment consists of multiple sites, each separate site usually has its own instance of VMware Horizon or Citrix XenDesktop/XenApp. Each of these separate VDI instances will need their own Golden Images from which virtual desktop pools will be created. In an ideal world, being able to use the same Golden Images for all desktop pools regardless of which site they are in would make the most sense as typically the Pools are the same between sites and this will keep desktop images consistent for all end users. However, until now, this has proven difficult to achieve.

In legacy HCI environments, the replication of virtual machines is very difficult and painfully slow. The main two replication options we see being used are:

  • vSphere Content Library – Using the built-in Content Library service, vCenters can be linked to provide the replication of Golden Images between vCenters
  • Manual Export/Import – Using vCenter to export the Golden Images into an OVA/OVF template, manually copying them to the remote sites and then importing the template into vCenter

There are, however, downsides to both of these methods. In both cases, the whole Golden Image is being replicated each time an update is made. If an image is 60GB in size and there are three remote sites, that’s quite a lot of data that needs to be transferred, this usually is a very slow transfer process and can put a heavy strain on the WAN infrastructure. Additionally, when these images are copied between sites, the vSphere Snapshots are lost in the process making it very difficult to roll changes back if there are issues as all snapshot history is lost.

Golden Image Sprawl

Because of these replication challenges, what we end up seeing is Golden Image sprawl, configuration drift, and an inconsistent-user user experience. Each site has its own set of Golden Images, which are similar to the other sites, but over time the configuration of these images deviates from the other sites. These additional Golden Images also add operational overhead. Each image will need to be patched and kept up to date. The more images you have, the harder it is to keep track of them and the longer updates take to roll out.

Quick And Easy Replication using Datrium DVX

It shouldn’t be this painful. It doesn’t need to be this painful! Using Datrium DVX it only takes a few clicks to replicate Golden Images between multiple sites. The following video (5 minutes) is a brief demonstration of how simple it is to replicate a new snapshot on a Golden Image to a second site.

Some of the key benefits to understand are:

Deduplication and Compression – DVX uses the always-on global deduplication and compression service to only send the changes made to the Golden Image. Rather than sending the whole virtual machine, DVX will only send the data that has changed. This dramatically improves replication times and reduces the load on the WAN infrastructure.

Persistent vSphere Snapshots – When Golden Images are replicated between sites, so are vSphere snapshots. So each Golden Image will show the same snapshot history, regardless of the site they are in. This makes it a lot easier to rollback and forward changes.

Backup, Restore And Replicate App Volumes, AppStacks And Writable Volumes

no problemOne of the biggest challenges I faced running VMware’s internal Horizon environment, was being able to backup, restore and replicate Writeable Volumes and AppStacks. Not being able to backup and replicate Writeable Volumes meant were unable to use Writables to capture our user’s data as we were unable to copy the data to an offline backup array for archive or replicate the data to our other data centers to be used in the event of a site failure.

This is no longer a challenge using Datrium DVX.

App Volumes

App Volumes is a product offered by VMware that has two main features:

  • AppStacks – Packaged applications that get connected/disconnect to a user’s virtual desktop during login/logoff.
  • Writable Volumes – Virtual disks that get connected/disconnect to a user’s virtual desktop during login/logoff. These virtual disks capture any changes made to the virtual desktop, giving a persistent user experience in a non-persistent VDI environment.

If you are not familiar with App Volumes, have a look at this great video – VMware App Volumes Technical Overview

Both AppStacks and Writable Volumes live their lives as VMDK files. This makes it very easy to connect/disconnect them to virtual machines during the login/logoff process. However, there is a massive downside to using VMDK files. AppStacks and Writeable Volume VMDK’s are not permanently associated with a virtual machine, which makes it is almost impossible to back them up using traditional vSphere backup software. Due to limitations in the vSphere API, traditional backup solutions can only back up virtual machines and virtual disks connected to the virtual machines. If a VMDK is not connected to a virtual desktop, it cannot be backed up at scale…. Until now.

Datrium DVX

Backup and Restore Writable Volumes and AppStacks

Running your Horizon environment on a DVX platform makes backing up and restoring App Volumes AppStacks and Writable Volumes almost a single click process. Don’t believe me? Check out this video I recently captured showing the backup and restore of a Writable Volume.

Replicate Writable Volumes and AppStacks

Replicating Writables and AppStacks is also just as easy as backing up and restoring them with Datrium DVX. I’ve also created another video below to show you how simple this process is.

Summary

Using the built-in Snapshot and Replication functions of Datrium DVX will make the management of your App Volumes deployment extremely simple and straightforward. I really wish I had this technology available to me when I was running VMware’s global VDI environment as I’m pretty sure I’d have a few less gray hairs than I do now 😉

Introducing Datrium CloudShift

Hey guys, I have some exciting news for you. Today, we (Datrium), announced CloudShift. Below I’ve summarized some of the things that really excite me about CloudShift. However, before I begin, I think it would be a good idea to quickly go over how Datrium DVX handles Backups and Replication for those of you who might be new to this solution.

Datrium DVX Backup and Replication

As mentioned in my previous post; What is Datrium DVX?, DVX is a Primary storage solution that provides extremely fast storage performance to virtual machines and applications running on DVX Compute Nodes. This is achieved by caching all required data locally on SSD devices installed on the Compute Nodes. DVX then adds a layer of protection by replicating all write IO’s over to the DVX Data Node which acts as a mirror copy for all of the data living in the SSDs on the Compute Nodes.

The Datrium On-Prem DVX system provides a built-in backup mechanism for protecting and restoring data. Protection Groups can be used to group a set of workloads together. Protection schedules are then be applied to the Protection Group based on how regularly data snapshots should be taken and how long they should be kept for. These Snapshots can then be replicated either to another On-Prem DVX system or to a Cloud DVX instance running in AWS.

Hopefully, that gives you enough background for the next section.

Datrium CloudShift

Datrium CloudShift is a SaaS-Based Disaster Recovery (DR) and Mobility orchestration solution, hosted in AWS, that can orchestrate a variety of DR scenarios;

  1. On-Prem (primary) failover to On-Prem (secondary) using backups that are stored at the On-Prem (secondary) site.
  2. On-Prem failover to Public Cloud using backups that are stored in the public cloud
  3. On-Prem failover to On-Prem & Cloud using backups that are either stored at the On-Prem (secondary) site or in the public cloud

I feel this covers the majority of failover scenarios that our customers need to restore their business in the event of a disaster.

I imagine your next question is, “If this a SaaS-based solution, how do I get my data from one data center to another, or to the Cloud? Well, this is where Datrium DVX and Cloud DVX come into play.

Scenario 1 – On-Prem > On-Prem

Scenario 1 is most commonly used when a customer has two data centers, both of which have a Datrium DVX. The DVX is configured to continually replicate data using Elastic Replication from the primary over to the secondary data center (and possibly vice versa). In the event of a failure in one of the datacenters, CloudShift will orchestrate the failover of workloads from one data center to the other. Thanks to the replication technology in DVX, Recovery Point Objective (RPO) times can be less than 1 minute.

CloudShift - On-Prem to On-Prem
 

Scenario 2 – On-Prem > Cloud

Read the rest of this entry »

What is Datrium DVX?

Having recently joined Datrium, one of my first tasks is to begin to understand the product Datrium calls DVX. As a way of helping me wrap my head around this technology, I’ve decided to blog about it. I plan on starting at a high-level and then slowly digging deeper under the covers as I learn more.

If you are interested in following my posts, you can subscribe here and follow me on Twitter.

So to begin with, let’s start at the 100 level.

What is Datrium DVX? – 100 Level

Datrium DVX offers Disaggregated Hyper-Converged Infrastructure (DHCI) along with Cloud Mobility. Yep, lots of buzzwords there! So what does that actually mean? Let’s start with the basic question, “What is the Datrium DVX solution made up of?”


Datrium DVX
Read the rest of this entry »

Goodbye VMware, Hello Datrium

datrium

After almost 8 years at VMware, I am excited to announce the next chapter in my career. Today, I’ll be joining Datrium as a Sr. Solutions Architect.

“Datrium?” I hear you say? “Yes, Datrium!”.

If you are not yet familiar with Datrium, you soon will be. As I begin to learn and understand the technologies that Datrium offers, I’ll be blogging them as a way to help myself and my readers learn more.

I’d just like to thank of my friends and colleagues that I leave behind at VMware. It’s been an amazing place to work and I will certainly miss everyone. Even though I am now longer at the Mothership, you’ll most certainly still see me around. Sometimes you have to take a leap of faith and put yourself into situations that you can learn and grow from.

Watch this space.