Not signed in (Sign In)

Categories

Vanilla 1.1.5 is a product of Lussumo. More Information: Documentation, Community Support.

Help keep Vanilla free:
Welcome Guest!
Want to take part in these discussions? If you have an account, sign in now.
If you don't have an account, apply for one now.
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 6th 2005
     # 51
    i like your alternate suggestion. it would be much easier to promote the normal users than to go through each one and figure out who's who.

    i think in the db i sent you, there are 2 admins, and 1 mod. the rest are all normal users. this is done by phpBBs ranking system. i dont think phpBB has groups like vbulletin.
  1.  # 52
    well it has a groups table and a users -> groups table.

    It also has the ranks table which has Site admin and whiney bitch which are linked to 2 users each. I cant see anywhere where it explains what these ranks have the ability to do though.

    But if you're sure all the sites run on the ranking system then i can easily enough build it in so it keeps people at the same level. Otherwise i'll do the alternative.
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 6th 2005
     # 53
    im looking at the admin panel now, and it appears that there are no set phpbb default rankings. the admin sets the levels to whatever they want. i think it would be easier to just administer the alternative.
  2.  # 54
    right. I'll do it like that then.

    What you recon? a dropdown of ex phpbb users? or a textbox? or something..?
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 6th 2005
     # 55
    i think either a dropdown or textbox would be sufficient. a dropdown would probably be the best for convenience purposes.
    •  
      CommentAuthorMark
    • CommentTimeJun 6th 2005
     # 56
    mini - I gave you admin access to Vanilla so you can take a look at how roles work.

    Yes, I know there are some css bugs that need fixing on the admin side of things.
  3.  # 57
    mark - cheers. Any chance i could borrow the autocomplete code or you could implement it for me for the user selection?
  4.  # 58
    douchebag huh?
  5.  # 59
    Could i also borrow the code execution timer to see how long this things taking to do a bigger database?
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 6th 2005
     # 60
    hows this coming along minisweeper? were you able to make it work?
    • CommentAuthorMinisweeper
    • CommentTimeJun 7th 2005 edited
     # 61
    Well i'm just waiting on mark to see if he'll stick the auto complete function in for me for the admin user selection.

    I've got a script timer and FYI it's taking around 0.1 seconds per 100 users to migrate, does this seem like a reasonable time? Bear in mind ofcourse that thats on a dedicated 2.4ghz box.

    Then i'll get started on the real fun of forum migration - shouldnt be too much harder i dont think but i'll need to work out the most efficient way of changing between phpBB and vanilla user id's (i reassigned them) and no doubt i'll find some interesting problems the phpBB team have created for me.

    I've got an exam tomorrow afternoon so i'll be 'revising' in the morning but if mark can mail me or something i'll try and get the user migration finished after my exam.
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 7th 2005
     # 62
    0.1 seconds is fine. i've used converters that were about 10 times as slow.

    everything else sounds great. if you need anymore phpbb info, let me know.
    •  
      CommentAuthorchrissy
    • CommentTimeJun 7th 2005
     # 63
    good luck with ur exam btw gez..
  6.  # 64
    Thanks. Exam was ok, had a bit of a brain block and its the first exam i've ever run out of time in but i think by the end i'd got nearly all the questions so hopefully it'll still be atleast a B.

    Outbreak - yeah, i'm happy enough that for even a 10k user forum it'll still take only a couple of seconds. Though i imagine the actual forum migration will take considerably longer as it'l be much more involved. I'm gonna try and keep it as low as possible (say 1 second per 1000 posts) using the very few optomisation techniques i'm aware of though. I'm sure some guys here will be able to help me out on that.

    Mark - if you could possibly get on MSN at some point so i can pick your brains again that'd be awesome.
    •  
      CommentAuthorcmacias
    • CommentTimeJun 7th 2005
     # 65
    Your next work is to make Invision Board Forum Converter xD
    •  
      CommentAuthorMark
    • CommentTimeJun 7th 2005
     # 66
    I'm super swamped with work-work. Can you email me? I always find email is actually faster than msn (where I tend to go off on tangents that have no bearing on the actual thing being discussed).
    •  
      CommentAuthor3stripe
    • CommentTimeJun 7th 2005
     # 67
    hi guys, sorry i totally forgot about this thread!!! looks like it's going well though - nice work minesweeper!!!!!!

    let me know if i can do anything to help (not that i can probably, but hey it's a nice gesture!
  7.  # 68
    Haha 3stripe, you can probably do a better job than me. I dont seem to be doing too badly though (till you see how fucked up and messy my code is :))

    I've done the category migrator. Now i just need to do discussions and posts. You could say i was half way there.

    Mark - an email will be coming your way soon. keep your eyes out.
  8.  # 69
    Right. I've done the Users Categories and Discussion migrators - So far it's taking around 1 second per 1000 users and 3000 discussions (seperately) on my dedicated server. (Categories arent that numerous and therefore unimportant but for the record it takes about 0.01 per 1000)

    I'm personally quite happy with this though I'd be interested to see how performance went on a shared hosting platform - eitherway i'm sure if needs be someone with much more advanced knowledge of SQL or probably even PHP could increase its efficiency tenfold.

    I'll do the posts tomorrow while i'm avoiding revision - cant see it taking too long but its a matter of me making myself sit down and do it.

    HOPEFULLY if I can have a word with mark I'll have it ready for release but I cant guarantee anything :)
    •  
      CommentAuthorcmacias
    • CommentTimeJun 9th 2005
     # 70
    Good work, minisweeper ! ;)
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 9th 2005
     # 71
    oh man, that'd be so amazing if it accompanied the release.
  9.  # 72
    Right. I've done the posts migrator so i think its just about ready. I am slightly concerned that it's taking 1 second per 1000 posts - depending what you guys think i recon it'd definately be worth someone with a better knowledge of SQL optomisation taking a look at it. Eitherway it works which is a good start.

    I need to do some tidying up and check through a few bits and pieces and see if theres anything else i can migrate that would be useful but i think the bulk of it is finished.

    One thing; how do i convert from the phpBB hex ip's to normal ones? (as a side note mark, i assume vanilla is setup to work with ipv6?)
    •  
      CommentAuthor3stripe
    • CommentTimeJun 9th 2005
     # 73
    dude those times sound fine to me... i've only got 200 posts or so to migrate!!!!!

    go' on my son!!!!!!!!
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 9th 2005
     # 74
    yeah, that is really more than ok. great job minisweeper.
    • CommentAuthorMinisweeper
    • CommentTimeJun 11th 2005 edited
     # 75
    Hmm. I'm just starting to tidy up the code while i test it out and the times are increasing slightly but i'll keep my eye on them and do what i can.

    I've also just realised that technically i can bring through all of phpBB's priv msg's as whispers but i'll have to work that out properly and see how complicated it'd be.

    I'm gonna be honest with you; on initial testing it's migrated the data a lot better than i expected with one minor issue - it appears to randomely miss content. And forget to count some of what is there in certain stats. Which is nice :)
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 11th 2005
     # 76
    any update minisweeper? did you get to fix that bug yet? it seems like you got this one pretty much covered.
  10.  # 77
    Yeah i'm just about finished, i worked out why it wasnt bringing some of the info through so I'm picking Marks brains about it and it should be pretty easily sortable.

    Still need to do a major tidy-up Op though.

    p.s. I havent even looked at priv vs whisper yet. So yeah...keep waiting :)
  11.  # 78
    Right. After a small amount of help from the genius i've finally got all the data migration sorted and i *think* its working rather splendidly.

    Code is still somewhat messy but i think the best thing i can do is pass it onto mark to have a look at my SQL queries and hope he can optomise them slightly (i dont see why they shouldnt be able to be built into a single query in each case and i'm sure this would decrease processing times dramatically).

    Then it just needs a bit of centralisation and design to neaten up the user view and it should be ready for pre-release; but i'll keep working with the big man and see how it goes.
    •  
      CommentAuthorMark
    • CommentTimeJun 14th 2005
     # 79
    This frickin dictionary thing is taking longer than I had thought. Man, there's a lot of text on this site. You wouldn't think it, but there is.
  12.  # 80
    Haha. Well i was just in the middle of tidying up and i fucked something up..so it could be a while :)

    Any chance you could get on msn sometime to have a focussed chat about mysql stuff? I wouldnt mind actually learning a few bits about it instead of just sending you my mess to clean up.
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 24th 2005
     # 81
    hows progress coming along?
    •  
      CommentAuthorchrissy
    • CommentTimeJun 24th 2005
     # 82
    well.. i was told to remind him later to do the whisper migration, and i believe thats one of the last things he has to do with the phpbb - vanilla migration.
    ive seen one of the migration tests hes done on some database, and it looks pretty sweet, all seems to work really well.
    gwan mini..
  13.  # 83
    Right. I've done a bit more testing with outbreak and we both seem quite convinced its pulling as much information through as possible - i've even added the option of keeping or resetting existing passwords now marks changed from password to md5.

    I just need to think through bbcode translations which I'll probably have to ignore unless anyone can think of a method to convert them easily?

    I imagine many people who would be using the phpBB converter may also desire to use a bbcode extension...whoevers willing to create one!
    •  
      CommentAuthorMark
    • CommentTimeJun 24th 2005
     # 84
    Yeah - I looked into getting something that is already written and plopping it into vanilla (like I did with Markdown), but the bbcode code is really frickin convoluted and all over the place. There's no central "BBCodify" function anywhere that I could see.

    If someone would write one, I'd be super happy. It would make a snazzy extension.
  14.  # 85
    is convoluted word of the day or something?
    How many 'bbcode's are there? And what do they actually do? I've never really played with it. Doesnt it just require for pseudo html to be converted to hardcore stuff when people add the comment?
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 25th 2005 edited
     # 86
    bbcode is pretty much custom coding to avoid html snippets from messing with the forum layout. read more here: http://www.phpbb.com/phpBB/faq.php?mode=bbcode
  15.  # 87
    Um. Well if its just whats on that page then it looks to me like the migration will simply be a matter of a few replacements of eg [b] to when translating the post data..i just need to work out doing that in php, regexp i assume? The main issue is the overhead it will add...but we'll see.

    As for an extension, i also dont see why it should be particularly difficult to implement?
    •  
      CommentAuthorMark
    • CommentTimeJun 25th 2005
     # 88
    You can implement a string formatter and it will be one of the options at the bottom of the comment input.
  16.  # 89
    Um. I'm sure i havent seen that post and this thread was showing as read...meh i'm probably being a fool.
    If i write the stuff to convert bbcode in existing threads i'll pass it your way mark so you can add it to the formatter ok?
    •  
      CommentAuthorMark
    • CommentTimeJun 25th 2005
     # 90
    That sounds swell. Just do it all in a single function and my job will be easy peezy :)
  17.  # 91
    ok. /me toddles off to learn regex replacements.

    Outbreak - as far as you know, are all the optional bbcode's on that page you linked me to?
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 25th 2005
     # 92
    yeah, that page seems to pretty much cover all of it.
    • CommentAuthorMinisweeper
    • CommentTimeJun 25th 2005 edited
     # 93
    So...is it cheating for me to just take this:

    <?php
    function replaceMessage($message) {
    $message = strip_tags($message, '<b></b><i></i><u></u><a></a><img>');

    $message = str_replace ("\n", "<BR>", "$message");
    // When you store the $message in a database you might get errors cause of the quotes
    $message = str_replace("[singleQuote]", "'", $message);
    $message = str_replace("[doubleQuote]", "\"", $message);

    $message = str_replace ("[U]", "<U>", "$message");
    $message = str_replace ("[/U]", "</U>", "$message");
    $message = str_replace ("[I]", "<I>", "$message");
    $message = str_replace ("[/I]", "</I>", "$message");
    $message = str_replace ("[B]", "<B>", "$message");
    $message = str_replace ("[/B]", "</B>", "$message");

    $message = replaceUrl($message);
    $message = replaceImg($message);

    return $message;
    }

    function replaceImg($message) {
    // Make image from [img]htp://.... [/img]
    while(strpos($message, "[img]")!==false){
    $begImg = strpos($message, "[img]");
    $endImg = strpos($message, "[/img]");
    $img = substr($message, $begImg, $endImg-$begImg+6);

    $link = substr($img, 5, $endImg - $begImg -5);
    $htmlImg = "<img src=$link border='0'>";

    $message = str_replace($img, $htmlImg, $message);
    // searches for other [img]-nodes
    }
    return $message;
    }

    function replaceUrl($message) {
    // Make link from [url]htp://.... [/url] or [url=http://.... ]text[/url]
    while(strpos($message, "[url")!==false){
    $begUrl = strpos($message, "[url");
    $endUrl = strpos($message, "[/url]");
    $url = substr($message, $begUrl, $endUrl-$begUrl+6);
    $posBracket = strpos($url, "]");

    if ($posBracket != null){
    if ($posBracket == 4){
    // [url]http://.... [/url]
    $link = substr($url, 5, $endUrl - $begUrl -5);
    $htmlUrl = "<a href=$link target='_blank'>$link</A>";
    } else {
    // [url=http://....]text[/url]
    $link = substr($url, 5, $posBracket-5);
    $text = substr($url, $posBracket+1, strpos($url, "[/url]") - $posBracket-1);
    $htmlUrl = "<a href=$link target='main'>$text</A>";
    }
    }

    $message = str_replace($url, $htmlUrl, $message);
    // searches for other [url]-nodes
    }
    return $message;
    }
    ?>

    off php.net and edit it ever so slightly?

    It seems silly to rewrite an identical function...
    •  
      CommentAuthorMark
    • CommentTimeJun 25th 2005
     # 94
    Cheat!
    Cheat until your testicles fall off.
    •  
      CommentAuthoroutbreak
    • CommentTimeJun 25th 2005
     # 95
    YES! CHEATING BABY!!!
  18.  # 96
    haha. So i guess i'm writing a new function then...
  19.  # 97
    Hmm. Either somethings fucked up or just the process of checking each comment is pushing execution times over the edge... I'll have another look but i'm thinking the bbcode translation will have to be an addon if anything.

    Quite fortunate though; i'd kinda forgotten about execution time limits. How can i get round them since in cases of over 25000 posts it will take more than the (presumably default) 30 seconds?
    • CommentAuthorDenied
    • CommentTimeJun 27th 2005
     # 98
    why don't you try something like mark did with the file browsers thumbnailer. run through x number of records, then display a status screen, and meta-refresh the page and move on to the next set of records.

    make sure that it says not to close the browser until the entire process is done, or something to that effect.

    i don't think you're going to be able to set the max_execution_time without having access to the php.ini and that's not feasible on shared hosting servers.
  20.  # 99
    Hmm. Yeah good thinking, i did have it setup to output a % done but for some reason it didnt occur to me to meta refresh it to keep it up to date.

    Maybe i'll leave that bit to mark as i imagine he's best making the gui anyway..my design abilities are even worse than my coding ones :)
    •  
      CommentAuthorMark
    • CommentTimeJun 27th 2005
     # 100
    You could also use ajax to do it table by table and just add comments to the page as things finish.

    If I were to start the thumbnailer all over again, that's how I'd do it.