vCloud Director provisionning support

[flamby]

Hi,

It would be great to add support for VCD 1.5 and the latest 5.1 for provisionning using the VCD Admin API.

Consider the following use case:

• as INPUT
  • a VCD organization
  • a vDC
  • a vApp Template (as for the hadoop distrib)
  • and one or several org network (considering some node are exposed on routed org network, and others are just connected to isolated network ; the exposed one is connected two both networks and can be a gateway
• as OUTPUT
  • an hadoop cluster in a vDC Org

[jessehu]

Hi @flamby , by far, vCD support is not a planned feature at least for Serengeti 1.0, since vCD doesn't have enough abstractions to support hadoop kind of workload deployment and disk management which is quite tight to low level infrastructure.

We will investigate the support for vCD if there is much requests from our customers or community. We are also happy to see the contribution from community to the cloud-manager and fog projects for supporting vCD.

Thanks.

[flamby]

As for VCD 5.1 (GA since a week or so), there are Storage Profile permitting storage tiering.
Also, 5.1 introduced hard-disk hot-add and remove, which was a big issue for cloudfoundry integration as well.

So I guess almost hadoop workloads can benefit of VCD integration now.

And when Distributed Storage will be available, the low cost and massively distributed storage it will provide will be a neat way to do hadoop on virtualization.

So please reconsider serengeti integration to VCD w/ the 5.1 API.

[jessehu]

Hi @flamby @junxiaotime, there is no new features in vCD 5.1 regarding to local storage. The only thing new on storage side is that vCD can leverage vSphere storage profiles to create multiple classes of storage capacity within the same provider/Org VDC thereby using their storage more effectively. "hard-disk hot-add and remove" has nothing to do with local disk but only for VM's disks.

[flamby]

Hi @jessehu

Sorry I did not realize you were refering to local storage. indeed, no improvement in this area.
But in the near future, something not tight to VCD but compliant with it could lead to what you want: Distributed Storage, also called vSAN.
Please have a look at this:
http://up2v.nl/2012/09/04/some-details-on-vmware-distributed-storage-or-vsan/
http://blogs.vmware.com/vsphere/2012/09/distributed-storage-tech-preview-with-video.html

[pfuhli]

We have an ongoing project to provide virtualized Hadoop Clusters to different tenants to process genome data. Currently we are evaluating Serengeti which accomplishes a lot of our requirements. Furthermore we are working with vCD to provide other vApps for different tenants. To pool all infrastructure resources we need the integration between Serengeti and vCD.

[kleong]

@pfuhli Hi, I'd like to learn more about your situation and needs. Please feel free to contact us at VMware. The Serengeti team can be reached at [email protected]. Thanks!

[patlachance]

Hello,
@kleong : did a feedback was provided by @pfuhli? Any roadmap to integrate vCloud to Serengeti?
Thanks and have a nice day!

[pfuhli]

No.
I only heard that this is planned on the longer timeframe.

Best regards,

danieldaniel
-----Original Message-----
From: patlachance [email protected]
Date: Thu, 07 Mar 2013 14:04:29
To: vmware-serengeti/[email protected]
Reply-To: vmware-serengeti/cloud-manager [email protected]
Cc: [email protected]
Subject: Re: [cloud-manager] vCloud Director provisionning support (#1)

Hello,
@kleong : did a feedback was provided by @pfuhli? Any roadmap to integrate vCloud to Serengeti?
Thanks and have a nice day!

---

Reply to this email directly or view it on GitHub:
#1 (comment)

[dtblomquist]

I am working on a large goverment project where VCD has already been implemeted. I am now looking into implementing a private (but elastic) Hadoop cluster and it would be great if we can do this in VCD with Serengeti. I am currently testing Serengiti on a vSphere test cluster but we are using VCD in production.

[kleong]

@patlachance @dtblomquist We are gathering requests for vCD support from users like yourselves. We review requests for enhancements from the community at regular intervals. At this time, we do not have plans or a timeframe in which to add vCD support in Serengeti. Feel free to reach out at [email protected] if you would like to discuss further on any Serengeti matters. Thanks.