Faster forums part two

[admin (no pm's please)]

I have started the template copying process on one server to see how it goes, did some last minute recoding as where forums have moved servers they may be old copies of the template lying around and that could have lead to old copies overwriting new edits on the template server

copies are progressing at about one per minute, so this will not be a fast transition.
_________________

Family Friendly Shareware | | Web Design/Services | Free Forums

[admin (no pm's please)]

Still under 200 done, and this really does need pacing. Not much point doing all three servers and then finding out there is an issue.
_________________

Family Friendly Shareware | | Web Design/Services | Free Forums

[admin (no pm's please)]

Found a small issue just now when I started the integration, and it will be a few more days before the support forums own template is old enough to go live with the system. Add that to the fact that only 523 template from one server are saved as yet and you end up with the conclusion that we may as well be patient. It will get there.
_________________

Family Friendly Shareware | | Web Design/Services | Free Forums

[admin (no pm's please)]

Trouble is that at this rate it may take more than a week to get there There are more than 10,000 templates on each server and after about 18 hours of processing we have only copied 624 templates.

In the long term that is not an issue, we can as a low priority process clearly save 400 templates a night, which is well in excess of the number likely to need copying.
_________________

Family Friendly Shareware | | Web Design/Services | Free Forums

[admin (no pm's please)]

1052...

I'm now running two processes one to copy the system templates. One to copy the user templates.

I'll code something up for the other servers to just copy the user templates, whilst marking system templates as already copied.
_________________

Family Friendly Shareware | | Web Design/Services | Free Forums

[admin (no pm's please)]

All system templates were copied.

I am now running the copy user template process on all servers, the code is also there on all servers, so very slowly all forums should be pulled into the system.
_________________

Family Friendly Shareware | | Web Design/Services | Free Forums

[admin (no pm's please)]

2147

I guess templates are copying at about 3 a minute. This may be a glacial pace, but when you think about it long term, are 3 templates a minute reaching a point where no one has edited them for 4 days? More like 3 templates an hour I would guess.
_________________

Family Friendly Shareware | | Web Design/Services | Free Forums

[admin (no pm's please)]

2850...


The length of this process is certainly going to put a halt to phpbb2 work for a bit, maybe that means it is time to get to grips with a phpbb3 biggy like the profile fields.
_________________

Family Friendly Shareware | | Web Design/Services | Free Forums

[admin (no pm's please)]

5469...

Not a lot else to say really, but at least it is setting aside time to look at other issues.

The phpbb3 profile fields has got to wait, there are no good solutions out there yet that I can see, and it is not time for our own bespoke solutions.

Instead todays work on optimising phpbb2 databases has been very productive, and hopefully will be able to go forum wide soon.
_________________

Family Friendly Shareware | | Web Design/Services | Free Forums

[Ask Mr. Religion]

Once everything is copied I hope you have some sort of diff copy scheme that will only pick up templates that were 'touched' so you don't have to go through this again. (I think I am understanding what is going on...then again...

AMR
_________________
Ask Mr. Religion
Reformed Theology Institute

[admin (no pm's please)]

The system is simple, when anyone even enters the template editor for a template, then the template is marked as needing to be loaded locally and to be copied again. This is a little brutal but how many people seriously edit templates that much?
_________________

Family Friendly Shareware | | Web Design/Services | Free Forums

[admin (no pm's please)]

6612..

As a matter of fact on this issue, I am running it as a manual process on each server from an ssh terminal. So when something glitched this morning and those terminals dropped out, so did the processes

When I kicked the processes off again, they took only a little while to process templates that had been previously deal with, and to deal with ones that were newly needing copying before they have carried on plodding away through the rest of the templates.
_________________

Family Friendly Shareware | | Web Design/Services | Free Forums

[MarkB]

[admin (no pm's please)]

So with the system your template would be offsited 85% of the time of thereabouts.

In practical terms I doubt people with the templates onsite will see a visible speed penalty, You go from using 4 servers to using 3 and the server you are falling back on is more lightly loaded than it was, and since the offsite templates are served from "shared" hosting it is questionable if they are that fast anyway! The reason they will appear fast is because of the greater parallelism involved.

---

_________________

Family Friendly Shareware | | Web Design/Services | Free Forums