Coopr
  1. Coopr
  2. COOPR-39

Add ability to create and configure a Mesos cluster

    Details

    • Type: New Feature New Feature
    • Status: Open Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 0.9.10 Code Name: Mensa
    • Component/s: provisioner
    • Labels:
      None
    • External issue ID:
      41
    • Rank:
      1|hzy99z:

      Activity

      Hide
      Chris Gianelloni added a comment -

      The community mesos cookbook requires the community zookeeper cookbook. It uses an optional library function from the zookeeper cookbook which allows for zookeeper discovery via exhibitor. Our hadoop::zookeeper and hadoop::zookeeper_server recipes in the hadoop cookbook do not provide this functionality and conflict with the community zookeeper cookbook. Also, Chef doesn't have a way to allow more than one cookbook to satisfy a dependency, even if we did provide the functionality. Supporting this means forking the community cookbook and removing/changing the dependency, which could be problematic, or writing our own cookbook.

      Show
      Chris Gianelloni added a comment - The community mesos cookbook requires the community zookeeper cookbook. It uses an optional library function from the zookeeper cookbook which allows for zookeeper discovery via exhibitor. Our hadoop::zookeeper and hadoop::zookeeper_server recipes in the hadoop cookbook do not provide this functionality and conflict with the community zookeeper cookbook. Also, Chef doesn't have a way to allow more than one cookbook to satisfy a dependency, even if we did provide the functionality. Supporting this means forking the community cookbook and removing/changing the dependency, which could be problematic, or writing our own cookbook.
      Hide
      Chris Gianelloni added a comment -

      I filed an issue ( SimpleFinance/chef-zookeeperCOOPR-72 ) to the maintainers of the zookeeper cookbook to split it into zookeeper and exhibitor cookbooks. If this happens, the mesos cookbook can depend on exhibitor (and not zookeeper) and become compatible with our hadoop cookbook's zookeeper recipes.

      Show
      Chris Gianelloni added a comment - I filed an issue ( SimpleFinance/chef-zookeeperCOOPR-72 ) to the maintainers of the zookeeper cookbook to split it into zookeeper and exhibitor cookbooks. If this happens, the mesos cookbook can depend on exhibitor (and not zookeeper) and become compatible with our hadoop cookbook's zookeeper recipes.
      Hide
      Chris Gianelloni added a comment -

      I filed an issue ( mdsol/mesos_cookbookCOOPR-31 ) to the mesos cookbook maintainers to see if they can relax the dependency requirement on the zookeeper cookbook.

      Show
      Chris Gianelloni added a comment - I filed an issue ( mdsol/mesos_cookbookCOOPR-31 ) to the mesos cookbook maintainers to see if they can relax the dependency requirement on the zookeeper cookbook.
      Hide
      Chris Gianelloni added a comment -

      ...and now we are getting somewhere. I created a split exhibitor cookbook and a pull request at wolf31o2/chef-exhibitorCOOPR-1 and gave the maintainers of the zookeeper cookbook full access to my repo. I also created SimpleFinance/chef-zookeeperCOOPR-73 which removes the exhibitor code from SimpleFinance/chef-zookeeper... once these are merged and pushed to the Chef community site, I can update mdsol/mesos_cookbookCOOPR-31 with a pull request to change the dependency from "depends zookeeper" to "recommends exhibitor" and nobody loses any functionality, and we can make Loom work with Mesos and the CDH/HDP zookeepers.

      Show
      Chris Gianelloni added a comment - ...and now we are getting somewhere. I created a split exhibitor cookbook and a pull request at wolf31o2/chef-exhibitorCOOPR-1 and gave the maintainers of the zookeeper cookbook full access to my repo. I also created SimpleFinance/chef-zookeeperCOOPR-73 which removes the exhibitor code from SimpleFinance/chef-zookeeper... once these are merged and pushed to the Chef community site, I can update mdsol/mesos_cookbookCOOPR-31 with a pull request to change the dependency from "depends zookeeper" to "recommends exhibitor" and nobody loses any functionality, and we can make Loom work with Mesos and the CDH/HDP zookeepers.
      Hide
      Chris Gianelloni added a comment -

      This is just waiting for a new release of the mdsol/mesos_cookbook to hit the community site. I would prefer wait for that, than try to pull this in from git and maintain it, ourselves.

      Show
      Chris Gianelloni added a comment - This is just waiting for a new release of the mdsol/mesos_cookbook to hit the community site. I would prefer wait for that, than try to pull this in from git and maintain it, ourselves.

        People

        • Assignee:
          Chris Gianelloni
          Reporter:
          Nitin Motgi
        • Votes:
          1 Vote for this issue
          Watchers:
          1 Start watching this issue

          Dates

          • Created:
            Updated: