mysql and mysqldump options in wordmove 6 #632

electricarts · 2022-01-11T09:12:53Z

electricarts
Jan 11, 2022

Flags to the underlying mysql and mysqldump commands are still possible to be proxied by configuring wp-cli. I wrote something about it in a paragraph of this PR, but for sure a more structured documentation will follow the future release.

Moreover I think that using wp-cli to do BD operations, as far as your wordpress is able to connect to the DB, then you should be able to go configuration-lessly: wp-cli reads configurations directly from your wordpress installation.

I read your paragraph about wp-cli configuration, but couldn't find anything about mysqloptions with the link to the official wp-cli docs. Maybe I'm just not smart enough to find the place. 😉

I assume that you can't install wordmove 6 "in parallel" with wordmove 5. I'll try to set all necessary installations and settings in a virtual machine to have a closer look at the interaction of Local (Flywheel) and wordmove 6. The necessary and special entries in connection with Local were so far:

Additional mysql and mysqldump entries in movefile.yml to connect the DB via socket:

name: local
user: root
password: "root
host: localhost
mysqldump_options: '--column-statistics=0 --socket "/Users/mario/Library/Application\ Support/Local/run/w_2HLYrYO/mysql/mysqld.sock"'
mysql_options: '--socket "/Users/mario/Library/Application\ Support/Local/run/w_2HLYrYO/mysql/mysqld.sock"'

Corresponding change to the wp-config entry:

/** MySQL hostname */
define( 'DB_HOST', 'localhost:/Users/mario/Library/Application Support/Local/run/w_2HLYrYO/mysql/mysqld.sock' );

alessandro-fazzi · 2022-01-11T09:36:35Z

alessandro-fazzi
Jan 11, 2022
Maintainer

Minor thing first, in the hope to simplify your work:

 ~/dev/sshwordmove   master     
 gem list wordmove

*** LOCAL GEMS ***

wordmove (5.2.2, 3.1.0)
 ~/dev/sshwordmove   master     
 wordmove --version
5.2.2
 ~/dev/sshwordmove   master     
 wordmove _3.1.0_ --version
3.1.0

The only thing is that the default one will always be the latest.

Alternatively RVM is probably the best version manager to simplify such scenarios (even if my defalut is rbenv) and is well documented (the site is old-fashioned, but take my word for it: the software it's stable and sturdy! ;) )

With RVM you could do something like (I'm not copy-pasting, just writing, so keep it wisely)

rvm install 3.1.0
gem install wordmove

rvm gemset create wordmove_alpha
rvm use 3.1.0@wordmove_alpha
gem install wordmove --pre

at that point you can switch from the default gemset to the custom one with

rvm use 3.1.0
rvm use 3.1.0@wordpress_alpha

whenever you'll need it. More info at https://rvm.io/gemsets/clear and long live to the good old RVM

4 replies

electricarts Jan 24, 2022
Author

I use chruby. Which is easier for a non-coder like me, but in this case probably not so good. 😉

I read that bundler (https://bundler.io) should have similar functionality. But I can't evaluate that and have to try it in a separate virtual machine. If you have experience with this (Bundler) it would be great if you could give me some tips.

alessandro-fazzi Jan 24, 2022
Maintainer

Be aware: any version manager you like will be ok. Chruby, rvm, rbenv, asdf are the ones I know. The easier for you will be the best.

A version manager provides the ability to install arbitrary versions of a language and - eventually - easily switch between them.

BUT bundler is NOT a version manager: it is the official dependencies manager for ruby project. And you don’t need it to simply install a single software packaged as a gem.

Unfortunately it seems like the new stable Ruby version didn’t land yet into Homebrew, but when it will it could be the perfect option to install Ruby if you don’t need to handle different versions at the same time.

electricarts Jan 24, 2022
Author

I am interested in the possibility to run the stable and the alpha version of wordmove in parallel. This is the possibility that is offered to me with gemsets at rvm, isn't it? The combination of wordmove 6/ruby 3.1 and wordmove 5/ruby 3.0 and a switching of these environments. And it's not clear to me if something like this could be implemented with chruby.

I used to have ruby installed via homebrew. But this always automatically updates to the current ruby version. In case I still want to use wordmove 5 this would not be so good.

alessandro-fazzi Jan 25, 2022
Maintainer

Yeah...I don't use chruby, but it seems absolutely straightforward:

ruby-build 3.0.3
gem install wordmove

ruby-build 3.1.0
gem install wordmove --pre

and you should be ready to have something like this

chruby 3.0.3
wordmove --version

> 5.2.2

chruby 3.1.0
wordmove --version

> 6.0.0.alpha.8

The concept is that while you switch from a ruby version to another you'll have different gems installed in each version.

Does it make sense to you?

alessandro-fazzi · 2022-01-11T09:38:55Z

alessandro-fazzi
Jan 11, 2022
Maintainer

In your scenrio, given this in wp-config

/** MySQL hostname */
define( 'DB_HOST', 'localhost:/Users/mario/Library/Application Support/Local/run/w_2HLYrYO/mysql/mysqld.sock' );

you should be able to simply comment/remove the local.database section and it should automagically work. 😃

If you really want to retain the --column-statistics=0 too, then you have to create a wp-cli.yml file in wordpress_path (usually side-by-side with your movefile.yml, but it depends on your setup) and add this config:

db export:
  column-statistics: 0

I don't know how good is the wp-cli's documentation about this thing, but the point is that you can pass any mysql flag to wp db import and any mysqldump flag to wp db export; this in command line would be

[--<field>=<value>]
    Extra arguments to pass to mysql. [Refer to mysql binary docs](https://dev.mysql.com/doc/refman/8.0/en/mysql-command-options.html).

while in wp-cli.yml would be like in my above example: you remove the -- and instead of the = you'll use the YAML syntax : to determine the value.

Hope it helps

0 replies

electricarts · 2022-01-20T16:18:18Z

electricarts
Jan 20, 2022
Author

First try with Alpha 8:

global:
  sql_adapter: wpcli

local:
  wordpress_path: /Users/mariopeischl/Local Sites/electricarts.test/app/public

staging:
  vhost: https://staging.electricarts.de
  wordpress_path: /sites/staging.electricarts.de/files

  database:
    name: st_electricarts
    user: st_electricarts
    password: "xxxxxxxxxxxxxxxxxxxxxxxxx"
    host: localhost

  exclude:
    - '.git/'
    - '.gitignore'
    - '.gitmodules'
    - '.env'
    - 'node_modules/'
    - 'bin/'
    - 'tmp/*'
    - 'Gemfile*'
    - 'Movefile'
    - 'movefile'
    - 'movefile.yml'
    - 'movefile.yaml'
    - 'wp-config.php'
    - 'wp-content/*.sql.gz'
    - '*.orig'
    - 'wp-cli.yml'

Files seems to be ok. , but errors for the DB:

▬▬ Backup local DB ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

    local | wp db export [secret]/wp-content/local-backup-1642694974.sql --allow-root --quiet
Error: Too many positional arguments: Sites/electricarts.test/app/public/wp-content/local-backup-1642694974.sql

    ❌  error | Local command status reports an error: Command failed with exit 1: wp
mariopeischl@Marios-Mac public %

Some errors at the beginning of the sync.

▬▬ Using Movefile: ./movefile.yml ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Error: Too many positional arguments: Sites/electricarts.test/app/public
Error: Too many positional arguments: Sites/electricarts.test/app/public
Error: Too many positional arguments: Sites/electricarts.test/app/public
Error: Too many positional arguments: Sites/electricarts.test/app/public
Error: This does not seem to be a WordPress installation.
Pass --path=`path/to/wordpress` or run `wp core download`.
Error: Too many positional arguments: Sites/electricarts.test/app/public
Error: Too many positional arguments: Sites/electricarts.test/app/public
Error: Too many positional arguments: Sites/electricarts.test/app/public
Error: Too many positional arguments: Sites/electricarts.test/app/public
Error: This does not seem to be a WordPress installation.
Pass --path=`path/to/wordpress` or run `wp core download`.

The Wordpress installation is there and working. So i don't know what this path error is.

1 reply

alessandro-fazzi Jan 21, 2022
Maintainer

YEah, as you've already pointed out the path was the problem here. There are discussions about it in the issue tracker, if I remember correctly. And anyway flywheel is really guilty about the choice tu use such a bogus naming for thir folder...IMHO obviously.

electricarts · 2022-01-20T16:58:18Z

electricarts
Jan 20, 2022
Author

Ok. Found it. Spaces in the path has to be escaped in .yml files. Changed the local wordpress_path (from "Local Sites" to "LocalSites").
There is the next problem. Something with OpenSSH keys ...

▬▬ Download remote DB ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

   remote | mysqldump --host=[secret] --user=st_electricarts --password=[secret] --result-file="[secret]wp-content/dump.sql" st_electricarts
/Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/authentication/ed25519_loader.rb:19:in `raiseUnlessLoaded': OpenSSH keys only supported if ED25519 is available (NotImplementedError)
net-ssh requires the following gems for ed25519 support:
 * ed25519 (>= 1.2, < 2.0)
 * bcrypt_pbkdf (>= 1.0, < 2.0)
See https://github.com/net-ssh/net-ssh/issues/565 for more information
Gem::MissingSpecError : "Could not find 'ed25519' (~> 1.2) among 104 total gem(s)
Checked in 'GEM_PATH=/Users/mariopeischl/.gem/ruby/3.1.0:/Users/mariopeischl/.rubies/ruby-3.1.0/lib/ruby/gems/3.1.0' , execute `gem env` for more information"
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/key_factory.rb:199:in `classify_key'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/key_factory.rb:50:in `load_data_private_key'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/key_factory.rb:41:in `load_private_key'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/authentication/key_manager.rb:166:in `sign'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/authentication/methods/publickey.rb:61:in `authenticate_with'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/authentication/methods/publickey.rb:19:in `block in authenticate'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/authentication/key_manager.rb:131:in `block in each_identity'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/authentication/key_manager.rb:128:in `each'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/authentication/key_manager.rb:128:in `each_identity'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/authentication/methods/publickey.rb:18:in `authenticate'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/authentication/session.rb:85:in `block in authenticate'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/authentication/session.rb:71:in `each'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh/authentication/session.rb:71:in `authenticate'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/net-ssh-6.3.0.beta1/lib/net/ssh.rb:254:in `start'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/photocopier-1.4.1/lib/photocopier/ssh.rb:71:in `session'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/photocopier-1.4.1/lib/photocopier/ssh.rb:44:in `exec!'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/wordmove-6.0.0.alpha.8/lib/wordmove/actions/ssh/run_remote_command.rb:29:in `block in <class:RunRemoteCommand>'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/action.rb:83:in `execute_action'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/action.rb:53:in `block (3 levels) in executed'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/action.rb:50:in `catch'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/action.rb:50:in `block (2 levels) in executed'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/context/key_verifier.rb:49:in `verify_keys'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/action.rb:47:in `block in executed'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/wordmove-6.0.0.alpha.8/lib/wordmove/actions/ssh/download_remote_db.rb:31:in `block in <class:DownloadRemoteDb>'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/action.rb:79:in `block in execute_action'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer.rb:25:in `call'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/action.rb:78:in `execute_action'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/action.rb:53:in `block (3 levels) in executed'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/action.rb:50:in `catch'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/action.rb:50:in `block (2 levels) in executed'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/context/key_verifier.rb:49:in `verify_keys'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/action.rb:47:in `block in executed'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer.rb:66:in `invoke_action'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer.rb:38:in `block in reduce'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer.rb:36:in `each'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer.rb:36:in `each_with_object'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer.rb:36:in `reduce'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer_log_decorator.rb:36:in `reduce'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/scoped_reducable.rb:6:in `scoped_reduce'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/reduce_if.rb:10:in `block in run'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer.rb:64:in `invoke_action'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer.rb:38:in `block in reduce'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer.rb:36:in `each'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer.rb:36:in `each_with_object'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer.rb:36:in `reduce'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/light-service-0.17.0/lib/light-service/organizer/with_reducer_log_decorator.rb:36:in `reduce'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/wordmove-6.0.0.alpha.8/lib/wordmove/organizers/ssh/pull.rb:29:in `call'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/wordmove-6.0.0.alpha.8/lib/wordmove/cli.rb:44:in `call_organizer_with'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/wordmove-6.0.0.alpha.8/lib/wordmove/cli.rb:113:in `call_pull_organizer_with'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/wordmove-6.0.0.alpha.8/lib/wordmove/cli.rb:104:in `call'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/dry-cli-0.7.0/lib/dry/cli.rb:116:in `perform_registry'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/dry-cli-0.7.0/lib/dry/cli.rb:65:in `call'
        from /Users/mariopeischl/.gem/ruby/3.1.0/gems/wordmove-6.0.0.alpha.8/exe/wordmove:7:in `<top (required)>'
        from /Users/mariopeischl/.gem/ruby/3.1.0/bin/wordmove:25:in `load'
        from /Users/mariopeischl/.gem/ruby/3.1.0/bin/wordmove:25:in `<main>'

4 replies

alessandro-fazzi Jan 21, 2022
Maintainer

You have traces at #629 and #586.

I'll try to solve this thing in order to remove this responsibilities (of adding configurations or installing other gems) from users, but the fact is that you can resolve that problem without waiting for my intervention ;)

Just to be clear: this is not a problem of the alpha version, but of the stable version too (that's because I tagget #586 as a bug)

alessandro-fazzi Jan 21, 2022
Maintainer

Obviously lemme know if you can't solve the issue following one of those solutions!

electricarts Jan 21, 2022
Author

Ok. The installations of the gems ed25519 and bcrypt_pbkdf have solved the problem.

In first tests, wordmove 6 works like a charm. Did "full" push/pull operations (--all).

alessandro-fazzi Jan 22, 2022
Maintainer

Your alpha testing is such a big contribution... I'm SO much grateful for it.

And for an alpha version you're reporting very good news!

We're also starting some concrete internal company testing in the coming week :)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

mysql and mysqldump options in wordmove 6 #632

{{title}}

Replies: 4 comments 9 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

mysql and mysqldump options in wordmove 6 #632

electricarts Jan 11, 2022

Replies: 4 comments · 9 replies

alessandro-fazzi Jan 11, 2022 Maintainer

electricarts Jan 24, 2022 Author

alessandro-fazzi Jan 24, 2022 Maintainer

electricarts Jan 24, 2022 Author

alessandro-fazzi Jan 25, 2022 Maintainer

alessandro-fazzi Jan 11, 2022 Maintainer

electricarts Jan 20, 2022 Author

alessandro-fazzi Jan 21, 2022 Maintainer

electricarts Jan 20, 2022 Author

alessandro-fazzi Jan 21, 2022 Maintainer

alessandro-fazzi Jan 21, 2022 Maintainer

electricarts Jan 21, 2022 Author

alessandro-fazzi Jan 22, 2022 Maintainer

electricarts
Jan 11, 2022

Replies: 4 comments 9 replies

alessandro-fazzi
Jan 11, 2022
Maintainer

electricarts Jan 24, 2022
Author

alessandro-fazzi Jan 24, 2022
Maintainer

electricarts Jan 24, 2022
Author

alessandro-fazzi Jan 25, 2022
Maintainer

alessandro-fazzi
Jan 11, 2022
Maintainer

electricarts
Jan 20, 2022
Author

alessandro-fazzi Jan 21, 2022
Maintainer

electricarts
Jan 20, 2022
Author

alessandro-fazzi Jan 21, 2022
Maintainer

alessandro-fazzi Jan 21, 2022
Maintainer

electricarts Jan 21, 2022
Author

alessandro-fazzi Jan 22, 2022
Maintainer