install for content-modeing-overhaul branches of everything #66

dannylamb · 2018-05-02T16:47:34Z

This PR is for installing all the required changes for testing Islandora/documentation#86.

A lot of it is commented out becaues it depends on code being in packagist, so once everything is tested and PRs are merged, we'll comment it back in. In the meantime, I have a gist that bridges the gap until then.

whikloj · 2018-05-07T17:59:40Z

Not sure if this is due to the vagrant 2.0.1 versus 2.0.3 differences, but vagrant and ansible are not able to login with this PR.

default: SSH address: 127.0.0.1:2200
    default: SSH username: ubuntu
    default: SSH auth method: password
    default: Warning: Connection reset. Retrying...
    default: Warning: Remote connection disconnect. Retrying...
    default: Warning: Connection reset. Retrying...
    default: Warning: Remote connection disconnect. Retrying...
    default: Warning: Connection reset. Retrying...
    default: Warning: Authentication failure. Retrying...
    default: Warning: Connection reset. Retrying...
    default:

Then it seems to continue building the box, but then once it is Ansible time...

TASK [install python] **********************************************************
Monday 07 May 2018  12:57:29 -0500 (0:00:00.050)       0:00:00.050 ************ 
fatal: [default]: UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host via ssh: Warning: Permanently added '[127.0.0.1]:2222' (ECDSA) to the list of known hosts.\r\nubuntu@127.0.0.1: Permission denied (publickey,password).\r\n", "unreachable": true}
	to retry, use: --limit @/sw/var/www/DAM2/claw-playbook/playbook.retry

I can't run the ansible-playbook command manually as it has the same problem.

I note that the port has changed from :2222 to :2200, maybe that is the problem? But I have no idea.

DiegoPino · 2018-05-07T18:14:10Z

Also 2.1.0 is out, maybe that is a fix version, worth testing out. It is also worth resetting all the environment vars/caches, a.k.a vagrant destroy && vagrant up when you update since many of the plugins and cached sessions could be outdated?

dannylamb · 2018-05-07T19:37:36Z

@whikloj Definitely should check that port.

I noticed this morning I was getting the same 'Connection reset' loop when vagrant ssh'ing into a box I built last week. I just gave it a while and it eventually sorted itself out. 🤷‍♂️

whikloj · 2018-05-07T19:50:22Z

Yeah it is the hosts file, need to update the port there. As this seems to be a vagrant version thing, we should make people aware but unless we want to make vagrant 2.0.3 the minimum version I don't know if there is anything to do.

whikloj · 2018-06-05T15:02:05Z

@dannylamb I'm going to hold on to this until packagist is ready and then you can uncomment those necessary lines.

…ybook into content-modeling-overhaul

dannylamb · 2018-06-05T18:52:37Z

ok, i think that's all the PRs associated with this issue. let me update this PR.

ajs6f · 2018-06-06T15:23:17Z

@dannylamb Once this PR is updated, would it be reasonable to try a full install (using this Ansible gear)?

dannylamb · 2018-06-06T18:50:26Z

@ajs6f Yes, it should work for ubuntu with both mysql and pgsql. I've hit a minor hurdle releasing Alpaca so the artifact is available to the installer, but once that gets sorted out it should work np.

ajs6f · 2018-06-06T18:52:08Z

@dannylamb Okay, cool, I'll take it out for my usual high-speed low -skill test drive on CentOS once I see a release of Alpaca (as a snapshot to Maven, I assume?).

whikloj · 2018-06-11T15:19:05Z

inventory/vagrant/group_vars/webserver/drupal.yml

+# Comment this back in once code gets merged and is available on packagist
+#  - "islandora/islandora:dev-8.x-1.x"
+#  - "islandora/openseadragon:dev-8.x-1.x"
+#  - "islandora/islandora_image:dev-8.x-1.x"


@dannylamb I think we are up-to-date in packagist. These can be uncommented now.

whikloj · 2018-06-11T15:19:16Z

inventory/vagrant/group_vars/webserver/drupal.yml

+# Comment this back in once code gets merged and is available on packagist
+#  - islandora_feature
+#  - islandora_openseadragon
+#  - islandora_image_feature


whikloj · 2018-06-12T19:48:22Z

Haha I think the comment

We can fix #66

Made Github confused.

whikloj · 2018-06-12T19:50:24Z

roles/internal/webserver-app/tasks/drupal.yml

+#- name: Import features
+#  command: "{{ drush_path }} -y fim --bundle=islandora islandora_feature,islandora_openseadragon,islandora_image_feature"
+#  args:
+ #   chdir: "{{ drupal_core_path }}"


Should/Can this be re-enabled?

whikloj · 2018-06-12T19:50:40Z

roles/internal/webserver-app/tasks/drupal.yml

+#- name: Index tags
+#  command: "{{ drush_path }} -y php:eval 'array_walk(\\Drupal::service('entity_type.manager')->getStorage('taxonomy_term')->loadMultiple(), function($term) { $term->save(); });'"
+#  args:
+ #   chdir: "{{ drupal_core_path }}"


Ditto re: re-enabling.

dannylamb · 2018-06-12T19:54:21Z

Sweet. We're end of day over here, but I'll try and push up the actual changes ASAP so we can test.

dannylamb · 2018-06-12T19:55:10Z

vagrant up 🚀

dannylamb · 2018-06-14T13:41:23Z

Ok, so I'm updating this to make the migrations go at the very end. Everything needs to be in place so stuff can get indexed appropriately, etc...

dannylamb · 2018-06-14T19:39:14Z

inventory/vagrant/group_vars/webserver/apache.yml

@@ -1,5 +1,6 @@
 ---

+apache_listen_ip: localhost


Adding this somehow messes with the virtual host file and now root is /var/www/html instead of /var/www/html/drupal/web

Likely a geerlingguy artefact. Any reason why we want it there in the first place? Not having it in the past hasn't caused any trouble that I'm aware of.

I think this will come up fine if we change this to:

apache_listen_ip: "*"

which is the default, so we could probably not set it as well.

I stand corrected, we do need the variable set for this PR. I'm testing @jonathangreen 's suggestion now.

whikloj · 2018-06-19T20:02:30Z

To fix an existing box, goto /etc/apache2/conf-enabled/islandora.conf and change the Virtualhost from localhost to _default_

…

On Tue, 19 Jun 2018, 18:10 Jonathan Green, ***@***.***> wrote: ***@***.**** commented on this pull request. ------------------------------ In inventory/vagrant/group_vars/webserver/apache.yml <#66 (comment)> : > @@ -1,5 +1,6 @@ --- +apache_listen_ip: localhost I think this will come up fine if we change this to: apache_listen_ip: "*" which is the default, so we could probably not set it as well. — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub <#66 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ACua4d39ZR4REhBdrX1RAkEDRuF8WEUgks5t-TCRgaJpZM4TvzHd> .

seth-shaw-unlv · 2018-06-19T23:01:48Z

Most recent run using apache_listen_ip set to "*" resulted in the following error:

TASK [Run migrations] **********************************************************
Tuesday 19 June 2018  15:51:41 -0700 (0:00:00.537)       0:11:34.810 ********** 
fatal: [default]: FAILED! => {"changed": true, "cmd": ["/var/www/html/drupal/vendor/drush/drush/drush", "-y", "-l", "*:8000", "mim", "--group=islandora"], "delta": "0:00:00.100176", "end": "2018-06-19 22:49:49.238597", "msg": "non-zero return code", "rc": 1, "start": "2018-06-19 22:49:49.138421", "stderr": "In DrupalKernel.php line 369:[Symfony\\Component\\HttpKernel\\Exception\\BadRequestHttpException]", "stderr_lines": ["", "In DrupalKernel.php line 369:", "", "  [Symfony\\Component\\HttpKernel\\Exception\\BadRequestHttpException]  ", ""], "stdout": "", "stdout_lines": []}

dannylamb · 2018-06-20T12:47:47Z

Yeah, using * blows up the migrations. That's where I'm stuck. I don't want to hard code localhost or 127.0.0.1 into the task, but can't seem to get the vhost to comply. At least not without postprocessing...

I may just add another task to the post-install, but that just seems layering more crap on top of something already not quite working right.

seth-shaw-unlv · 2018-06-20T14:19:48Z

Well, we should be able to use the migrate command without the uri switch, as it is theoretically only necessary for multi-site installations. (Can we make that assumption with the playbook?)

I can't test removing the option this morning (out of the office and won't make today's call) but I can look into it this afternoon if you don't beat me to it.

seth-shaw-unlv · 2018-06-20T15:43:06Z

Or, could we use apache_vhosts.servername instead of apache_listen_ip for the migrate command?

I need to stop thinking about this away from work and my dev env...

… fool

jonathangreen · 2018-06-20T18:37:03Z

This is so close. We need 2 changes in the requirements.yml:
https://github.com/Islandora-Devops/claw-playbook/blob/master/requirements.yml#L44-L46
Needs to be

- src: https://github.com/Islandora-Devops/ansible-role-alpaca
  name: Islandora-Devops.alpaca
  version: 0.0.2

and
https://github.com/Islandora-Devops/claw-playbook/blob/master/requirements.yml#L60-L62
needs to be:

- src: https://github.com/Islandora-Devops/ansible-role-crayfish
  name: Islandora-Devops.crayfish
  version: 0.0.2

So we pull in the correct requirements from crayfish and alpaca.

jonathangreen · 2018-06-20T18:46:15Z

vagrant up 🚀

lets see this thing go!

seth-shaw-unlv · 2018-06-20T19:19:07Z

It's alive!

Note: I just ran it using CentOS which requires a few version updates (ansible-role-crayfish: master, ansible-role-grok: 0.0.2, and ansible-role-karaf: master).

jonathangreen · 2018-06-20T19:38:59Z

I sliced a new version for ansible-role-karaf so we can update to 0.0.2 for cent.

seth-shaw-unlv · 2018-06-20T19:40:57Z

@jonathangreen thanks. Could you also merge islandora-deprecated/ansible-role-crayfish/pull/7 and cut a new ansible-role-crayfish version, too, while you're at it?

Natkeeran · 2018-06-20T19:55:02Z

Fired up into a VM and seems good (i.e loads it at 8000, syncs to feodra and indexes in triplestore). 👍

jonathangreen

jonathangreen · 2018-06-20T21:15:13Z

@seth-shaw-unlv I merged islandora-deprecated/ansible-role-crayfish#7 and sliced a release for 0.0.3. I figured I'd merge this PR since it was working for me on Ubuntu.

Want to make a new PR to update the roles as we need for Cent and we'll work on getting that merged?

seth-shaw-unlv · 2018-06-20T21:32:54Z

Sure. I'm going to do it as part of Islandora/documentation/issues/809. I have a local branch with updated requirements I'm testing right now.

dannylamb · 2018-06-20T22:25:58Z

Just spun up a fresh box and looks like islandora-connector-houdini is available in the feature but not installed in Karaf.

dannylamb · 2018-06-20T22:27:22Z

Ok, I see what I need to do. In the meantime, just feature:install islandora-connector-houdini. I'll issue a PR shortly.

dannylamb · 2018-06-21T02:09:27Z

D'oh... or just run ansible-galaxy install --force --role-file=requirements.yml --roles-path=roles/external beforehand...

install for content-modeing-overhaul branches of everything

9a75217

Merge branch 'master' of https://github.com/Islandora-Devops/claw-pla…

56677c9

…ybook into content-modeling-overhaul

dannylamb mentioned this pull request Jun 5, 2018

add postgresql migration Islandora/Crayfish#47

Merged

This was referenced Jun 7, 2018

claw-playbook: Ubuntu and CentOS Install dependencies with composer require - failed! Islandora/documentation#841

Closed

Removing 5.6 Islandora/documentation#843

Merged

whikloj reviewed Jun 11, 2018

View reviewed changes

whikloj closed this in Islandora/documentation#843 Jun 12, 2018

whikloj reopened this Jun 12, 2018

whikloj reviewed Jun 12, 2018

View reviewed changes

works, but drupal is accessed through localhost:8000/drupal/web :(

ed8f7fd

dannylamb commented Jun 14, 2018

View reviewed changes

dannylamb mentioned this pull request Jun 20, 2018

Enable islandora-connector-houdini Islandora/documentation#845

Closed

Just leave it hardcoded since it runs on webserver anyway. I'm such a…

6fcc4c3

… fool

Bumping internal roles

fe0b52a

jonathangreen approved these changes Jun 20, 2018

View reviewed changes

jonathangreen merged commit 364faee into Islandora-Devops:master Jun 20, 2018

seth-shaw-unlv mentioned this pull request Jun 20, 2018

Beef from Gemini/MySQL on CentOS Islandora/documentation#828

Closed

install for content-modeing-overhaul branches of everything #66

install for content-modeing-overhaul branches of everything #66

Conversation

dannylamb commented May 2, 2018

whikloj commented May 7, 2018

DiegoPino commented May 7, 2018

dannylamb commented May 7, 2018

whikloj commented May 7, 2018

whikloj commented Jun 5, 2018

dannylamb commented Jun 5, 2018

ajs6f commented Jun 6, 2018

dannylamb commented Jun 6, 2018

ajs6f commented Jun 6, 2018

Choose a reason for hiding this comment

Choose a reason for hiding this comment

whikloj commented Jun 12, 2018

Choose a reason for hiding this comment

Choose a reason for hiding this comment

dannylamb commented Jun 12, 2018

dannylamb commented Jun 12, 2018

dannylamb commented Jun 14, 2018

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

whikloj commented Jun 19, 2018 via email

seth-shaw-unlv commented Jun 19, 2018 • edited Loading

dannylamb commented Jun 20, 2018

seth-shaw-unlv commented Jun 20, 2018

seth-shaw-unlv commented Jun 20, 2018

jonathangreen commented Jun 20, 2018

jonathangreen commented Jun 20, 2018 • edited Loading

seth-shaw-unlv commented Jun 20, 2018

jonathangreen commented Jun 20, 2018

seth-shaw-unlv commented Jun 20, 2018

Natkeeran commented Jun 20, 2018 • edited Loading

jonathangreen left a comment

Choose a reason for hiding this comment

jonathangreen commented Jun 20, 2018

seth-shaw-unlv commented Jun 20, 2018

dannylamb commented Jun 20, 2018

dannylamb commented Jun 20, 2018

dannylamb commented Jun 21, 2018

seth-shaw-unlv commented Jun 19, 2018 •

edited

Loading

jonathangreen commented Jun 20, 2018 •

edited

Loading

Natkeeran commented Jun 20, 2018 •

edited

Loading