Docker compose clouseau example #182

rkleine · 2020-06-03T13:30:02Z

Overview

Docker compose example with clouseau plugin

GitHub issue number

Fixed #8

kocolosk · 2020-06-03T14:20:59Z

Nice! That’s a very welcome contribution. Will take a closer look later today.

wohali · 2020-06-03T15:46:20Z

We might also want to put this into the CouchDB docs, @kocolosk .

kocolosk · 2020-06-04T01:05:45Z

Yes that's a good idea @wohali.

@rkleine, I'd like to pull a version of these instructions into the main README of the repo for greater visibility. I'm mulling over simplifying them by pointing to a pre-built Clouseau image instead of including all of the configuration files and instructions to assemble a working container from a vanilla OpenJDK image. Of course we don't have any official or semi-official image for Clouseau, so that complicates matters a bit. Will give it some thought. Just wanted to keep you posted.

wohali · 2020-06-04T04:21:29Z

@kocolosk I'd only suggested a subdir because I assumed the files mentioned in here would go in there, separate to the README.

We can def. put this in the README here as well as ensure they end up in the Docker official docs if you like, as well as the main CouchDB docs.

rkleine · 2020-06-09T12:51:03Z

Hi @kocolosk, Im using a local docker clouseau image. Maybe this save you some time

; ./etc/clouseau.ini
[clouseau]
name[email protected]
cookie=monster
dir=/var/lib/clouseau
max_indexes_open=500

# ./etc/log4j.properties
log4j.rootLogger=debug, CONSOLE
log4j.appender.CONSOLE=org.apache.log4j.ConsoleAppender
log4j.appender.CONSOLE.layout=org.apache.log4j.PatternLayout
log4j.appender.CONSOLE.layout.ConversionPattern=%d{ISO8601} %c [%p] %m%n

# Dockerfile
FROM openjdk:8-alpine

RUN apk add --update unzip

RUN wget -q -O clouseau-2.17.0-dist.zip https://github.com/cloudant-labs/clouseau/releases/download/2.17.0/clouseau-2.17.0-dist.zip
RUN unzip clouseau-2.17.0-dist.zip
RUN rm -rf clouseau-2.17.0-dist.zip

RUN mkdir -p /opt/clouseau/etc
COPY etc /opt/clouseau/etc

CMD java -server \
      -classpath '/clouseau-2.17.0/*' \
      -Xmx2G -Dsun.net.inetaddr.ttl=30 \
      -Dsun.net.inetaddr.negative.ttl=30 \
      -Dlog4j.configuration=file:/opt/clouseau/etc/log4j.properties \
      -XX:OnOutOfMemoryError="kill -9 %p" \
      -XX:+UseConcMarkSweepGC \
      -XX:+CMSParallelRemarkEnabled com.cloudant.clouseau.Main /opt/clouseau/etc/clouseau.ini

# build
docker build --tag clouseau:2.17.0 --tag clouseau:latest .

With docker run

# start couchdb
docker run --rm -p "5984:5984" --name couchdb -e COUCHDB_USER=admin -e COUCHDB_PASSWORD=admin -e NODENAME=127.0.0.1 -e ERL_FLAGS="-setcookie monster" couchdb:3.1.0

# start cluseau
docker run --rm --network=container:couchdb --name clouseau clouseau:2.17.0

Or with docker-compose up

version: '3.8'
services:
  couchdb1:
    image: couchdb:3.1.0
    restart: always
    ports:
      - 5984:5984
    environment:
      - COUCHDB_USER=admin
      - COUCHDB_PASSWORD=admin
      - NODENAME=127.0.0.1
      - ERL_FLAGS=-setcookie monster

  clouseau1:
    image: clouseau:2.17.0
    restart: always
    depends_on:
      - couchdb1
    network_mode: service:couchdb1

docker-compose up

# test
curl -sSL http://localhost:5984 | grep "search"

wohali · 2021-03-16T20:51:43Z

@rkleine Would love to merge this. Can you unify this with the changes proposed in #186 - if needed?

Alternately if you'd like to just put this directly in our documentation, I'd be happy to merge a PR in our repo there, https://github.com/apache/couchdb-documentation/pulls

klaemo · 2021-03-23T09:08:05Z

I tried to get it running the way @rkleine described. Definitely got much further than I did on my own :D
Unfortunately clouseau crashes the instant I curl http://localhost:5984, though 🤔

clouseau1_1          | 2021-03-23 08:59:14,788 clouseau.main [INFO] Clouseau running as [email protected]
clouseau1_1          | 2021-03-23 08:59:14,796 scalang.ErlangNode [DEBUG] deliverMonitor Pid('[email protected],2,1,2) -> Pid('[email protected],3,1,2) (Reference('[email protected],WrappedArray(0, 0, 0),2))
clouseau1_1          | 2021-03-23 08:59:14,799 scalang.ErlangNode [DEBUG] deliverMonitor Pid('[email protected],2,1,2) -> Pid('[email protected],4,1,2) (Reference('[email protected],WrappedArray(1, 0, 0),2))
clouseau1_1          | 2021-03-23 08:59:14,801 scalang.ErlangNode [DEBUG] deliverMonitor Pid('[email protected],2,1,2) -> Pid('[email protected],5,1,2) (Reference('[email protected],WrappedArray(2, 0, 0),2))
clouseau1_1          | 2021-03-23 08:59:43,372 scalang.node.ErlangHandler [DEBUG] handler message HandshakeSucceeded('[email protected],[id: 0x0f3eed1a, /127.0.0.1:45801 => /127.0.0.1:36147])
clouseau1_1          | 2021-03-23 08:59:43,380 scalang.node.ErlangHandler [DEBUG] handler message MonitorMessage(Pid('couchdb@1,4876,0,2),'net_k,Reference('couchdb@1,Vector(80488, 1221066753, 1159136377),2))
clouseau1_1          | 2021-03-23 08:59:43,381 scalang.ErlangNode [DEBUG] monitor Pid('couchdb@1,4876,0,2) -> 'net_k (Reference('couchdb@1,Vector(80488, 1221066753, 1159136377),2))
clouseau1_1          | 2021-03-23 08:59:43,382 scalang.ErlangNode [DEBUG] pids List(Pid('[email protected],1,1,2), Pid('[email protected],2,1,2), Pid('[email protected],3,1,2), Pid('[email protected],5,1,2), Pid('[email protected],0,0,2), Pid('[email protected],4,1,2))
clouseau1_1          | 2021-03-23 08:59:43,382 scalang.ErlangNode [WARN] Try to monitor non-live process: Pid('couchdb@1,4876,0,2) -> 'net_k (Reference('couchdb@1,Vector(80488, 1221066753, 1159136377),2))
clouseau1_1          | 2021-03-23 08:59:43,382 scalang.ErlangNode [DEBUG] handling monitor exit for Monitor(Pid('couchdb@1,4876,0,2),'net_k,Reference('couchdb@1,Vector(80488, 1221066753, 1159136377),2))
clouseau1_1          | 2021-03-23 08:59:43,383 scalang.ErlangNode [DEBUG] node scalang.ErlangNode@2e775cbc sending MonitorExitMessage('net_k,Pid('couchdb@1,4876,0,2),Reference('couchdb@1,Vector(80488, 1221066753, 1159136377),2),'noproc)
clouseau1_1          | 2021-03-23 08:59:43,385 scalang.epmd.EpmdHandler [DEBUG] Oh snap channel closed.
clouseau1_1          | 2021-03-23 08:59:43,385 scalang.epmd.EpmdHandler [DEBUG] Oh snap channel closed.
clouseau1_1          | 2021-03-23 08:59:43,387 scalang.node.ErlangHandler [DEBUG] handler message RegSend(Pid('couchdb@1,4876,0,2),'net_k,('$gen_,(Pid('couchdb@1,4876,0,2),Reference('couchdb@1,Vector(80488, 1221066753, 1159136377),2)),('is_a,'couchdb@1)))
clouseau1_1          | 2021-03-23 08:59:43,388 scalang.node.ErlangHandler [ERROR] error caught in erlang handler '[email protected]
[...] java stacktrace
clouseau1_1          | 2021-03-23 08:59:43,389 scalang.node.ErlangHandler [INFO] channel disconnected org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext@3f55b189 [id: 0x0f3eed1a, /127.0.0.1:45801 :> /127.0.0.1:36147] DISCONNECTED. peer: '[email protected]

I'm not sure what's going on. It looks like it can indeed reach epmd, but then it exits?

CouchDB is running fine in its container and I can successfully reach couch on localhost from within the clouseau container:

[info] 2021-03-23T08:50:58.630473Z [email protected] <0.11.0> -------- Application couch started on node '[email protected]'
[...]
[notice] 2021-03-23T08:54:50.455952Z [email protected] <0.2199.0> a6c58336d7 finish_cluster: ok
[...]
[notice] 2021-03-23T08:55:53.487534Z [email protected] <0.3014.0> 6488627f8b localhost:5984 172.24.0.1 undefined GET / 200 ok 84

Any ideas?

Update: Played around with https://hub.docker.com/r/kocolosk/couchdb-search which gives me the following errors:

In the CouchDB container:

[error] 2021-03-26T14:07:20.458212Z [email protected] <0.1148.0> -------- ** '[email protected]': Connection attempt to node '[email protected]' aborted since it cannot handle ["UTF8_ATOMS"].**

In the couchdb-search container:

couchdb-search_1     | 2021-03-26 14:07:20,467 scalang.node.ServerHandshakeHandler [ERROR] Channel closed during handshake
couchdb-search_1     | 2021-03-26 14:07:20,471 scalang.node.ErlangHandler [DEBUG] handler message HandshakeFailed('[email protected])
couchdb-search_1     | 2021-03-26 14:09:07,923 scalang.node.ErlangHandler [INFO] channel disconnected org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext@5de467e4 [id: 0x7785090e, /127.0.0.1:50937 :> /127.0.0.1:41465] DISCONNECTED. peer: null

paolosanchi · 2023-11-08T10:45:00Z

Hi @kocolosk, Im using a local docker clouseau image. Maybe this save you some time

; ./etc/clouseau.ini
[clouseau]
name[email protected]
cookie=monster
dir=/var/lib/clouseau
max_indexes_open=500

# ./etc/log4j.properties
log4j.rootLogger=debug, CONSOLE
log4j.appender.CONSOLE=org.apache.log4j.ConsoleAppender
log4j.appender.CONSOLE.layout=org.apache.log4j.PatternLayout
log4j.appender.CONSOLE.layout.ConversionPattern=%d{ISO8601} %c [%p] %m%n

# Dockerfile
FROM openjdk:8-alpine

RUN apk add --update unzip

RUN wget -q -O clouseau-2.17.0-dist.zip https://github.com/cloudant-labs/clouseau/releases/download/2.17.0/clouseau-2.17.0-dist.zip
RUN unzip clouseau-2.17.0-dist.zip
RUN rm -rf clouseau-2.17.0-dist.zip

RUN mkdir -p /opt/clouseau/etc
COPY etc /opt/clouseau/etc

CMD java -server \
      -classpath '/clouseau-2.17.0/*' \
      -Xmx2G -Dsun.net.inetaddr.ttl=30 \
      -Dsun.net.inetaddr.negative.ttl=30 \
      -Dlog4j.configuration=file:/opt/clouseau/etc/log4j.properties \
      -XX:OnOutOfMemoryError="kill -9 %p" \
      -XX:+UseConcMarkSweepGC \
      -XX:+CMSParallelRemarkEnabled com.cloudant.clouseau.Main /opt/clouseau/etc/clouseau.ini

# build
docker build --tag clouseau:2.17.0 --tag clouseau:latest .

With docker run

# start couchdb
docker run --rm -p "5984:5984" --name couchdb -e COUCHDB_USER=admin -e COUCHDB_PASSWORD=admin -e NODENAME=127.0.0.1 -e ERL_FLAGS="-setcookie monster" couchdb:3.1.0

# start cluseau
docker run --rm --network=container:couchdb --name clouseau clouseau:2.17.0

Or with docker-compose up

version: '3.8'
services:
  couchdb1:
    image: couchdb:3.1.0
    restart: always
    ports:
      - 5984:5984
    environment:
      - COUCHDB_USER=admin
      - COUCHDB_PASSWORD=admin
      - NODENAME=127.0.0.1
      - ERL_FLAGS=-setcookie monster

  clouseau1:
    image: clouseau:2.17.0
    restart: always
    depends_on:
      - couchdb1
    network_mode: service:couchdb1

docker-compose up

# test
curl -sSL http://localhost:5984 | grep "search"

This 100% worked with couchdb version 3.1.0, but if I bump to 3.3.2 I get this error:

 %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
   Monster detected ohno!, aborting startup.
   Please change the Erlang cookie in vm.args to the same
   securely generated random value on all nodes of this cluster.
 %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

I've removed the ERL_FLAGS=-setcookie monster and couchdb starts, but when I query the index I get this error:

Could not connect to the Clouseau Java service at [email protected]

big-r81 · 2023-11-08T12:02:07Z

Bring back the setcookie line. You need to set a cookie value other than "monster".

Docker compose clouseau example

893aa31

rkleine added 3 commits June 11, 2020 09:03

Merge branch 'master' into clouseau-compose

4482af7

Merge branch 'master' into clouseau-compose

0bae9c0

Merge branch 'master' into clouseau-compose

63b95b7

kocolosk changed the base branch from master to main November 11, 2020 16:47

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Docker compose clouseau example #182

Docker compose clouseau example #182

rkleine commented Jun 3, 2020

kocolosk commented Jun 3, 2020

wohali commented Jun 3, 2020

kocolosk commented Jun 4, 2020

wohali commented Jun 4, 2020

rkleine commented Jun 9, 2020 •

edited

Loading

wohali commented Mar 16, 2021

klaemo commented Mar 23, 2021 •

edited

Loading

paolosanchi commented Nov 8, 2023 •

edited

Loading

big-r81 commented Nov 8, 2023

Docker compose clouseau example #182

Are you sure you want to change the base?

Docker compose clouseau example #182

Conversation

rkleine commented Jun 3, 2020

Overview

GitHub issue number

kocolosk commented Jun 3, 2020

wohali commented Jun 3, 2020

kocolosk commented Jun 4, 2020

wohali commented Jun 4, 2020

rkleine commented Jun 9, 2020 • edited Loading

wohali commented Mar 16, 2021

klaemo commented Mar 23, 2021 • edited Loading

paolosanchi commented Nov 8, 2023 • edited Loading

big-r81 commented Nov 8, 2023

rkleine commented Jun 9, 2020 •

edited

Loading

klaemo commented Mar 23, 2021 •

edited

Loading

paolosanchi commented Nov 8, 2023 •

edited

Loading