![ThinkDing](images/misc/logo.gif) |
|
![Old](images/statusicon/post_old.gif)
09-02-2005, 09:41 PM
|
Junior Member
|
|
Join Date: Sep 2005
Posts: 5
|
|
DB Size Questions
From your site:
Quote:
tdSearch works well on a smaller sized table. The script has also been used on a table of about 100K, but at 100K the script can show a performance hit, especially when LIKE queries are allowed. For example, using a table of about 100K and 20,000 rows, searching on two letters takes about 10 seconds, searching on three letters takes about 7 seconds, and searching on four letters takes about 4 seconds. tdSearch has the option to set the number of characters to be used in LIKE queries.
|
The site that I am working on will contain rather long articles.
So far I have 36 entries and my articles table is 258.1 KB.
With your software, what search times are can I expect now and as the sight grows? Are there optimizations to the software or my db that will help? Or should I assume that tdSearch will not be a good fit due to size and the time it takes to run the query?
I am looking for as turnkey a solution as possible.
|
![Old](images/statusicon/post_old.gif)
09-03-2005, 10:57 PM
|
![SoapinTrucker's Avatar](image.php?s=5dda35265d4ea00bdc36fd5c56677205&u=5&dateline=1121980122) |
Member
|
|
Join Date: Jul 2005
Location: Fresno, California
Posts: 38
|
|
I am not the author obviously, but for what it is worth, I have a search engine built using tdSearch, and currently it has 15,561 links (rows) in it, some containing large amounts of keywords, and/or descriptions.
Here at home, I have a cable modem ISP (Charter), and see no slow down at all in searches, unless they are complicated, using multiple words and boolean logic, even then it is minimal!
Try it yourself, and see what you think!
http://spiderweb.tayon.com/
Good luck!
Mike
|
![Old](images/statusicon/post_old.gif)
09-05-2005, 06:14 PM
|
Administrator
|
|
Join Date: Jul 2005
Posts: 46
|
|
Personally, I would hesitate in using tdSearch on min's size of a table. I haven't run tests with min's specs, but processing through 258K, even if only 36 rows, may be slow. Soap, just curious, what is the size of your search table? BTW, nice spiderweb logo.
|
![Old](images/statusicon/post_old.gif)
09-05-2005, 10:33 PM
|
![SoapinTrucker's Avatar](image.php?s=5dda35265d4ea00bdc36fd5c56677205&u=5&dateline=1121980122) |
Member
|
|
Join Date: Jul 2005
Location: Fresno, California
Posts: 38
|
|
Hi Winston!
Thanks for the logo comment
The size of the actual file I upload to phpMyAdmin is about 7-8 meg now!!!
![EEK!](images/smilies/eek.gif) phpMyAdmin shows it as 13.1 meg.......................
( Data 7,699 KB, Index 5,715 KB, Total 13,414 KB)
As of a minute ago that is, and contains 22,207 rows/links!
Mike
Last edited by SoapinTrucker : 09-05-2005 at 10:47 PM.
Reason: update table size info
|
![Old](images/statusicon/post_old.gif)
09-05-2005, 10:52 PM
|
![SoapinTrucker's Avatar](image.php?s=5dda35265d4ea00bdc36fd5c56677205&u=5&dateline=1121980122) |
Member
|
|
Join Date: Jul 2005
Location: Fresno, California
Posts: 38
|
|
Winston, does the way a db/table get indexed help the speed? (I'm guessing it does, but the point is, HOW to make an index that speedy........mine seems to be in overdrive, it is fast! (LOL ))
|
![Old](images/statusicon/post_old.gif)
09-06-2005, 12:57 AM
|
Administrator
|
|
Join Date: Jul 2005
Posts: 46
|
|
Quote:
Originally Posted by SoapinTrucker
![EEK!](images/smilies/eek.gif) phpMyAdmin shows it as 13.1 meg.......................
( Data 7,699 KB, Index 5,715 KB, Total 13,414 KB)
As of a minute ago that is, and contains 22,207 rows/links!
|
Hmm, I may have mistyped 100K, but I'm not sure what I meant, as I no longer have that data. I just searched on "a or e or i or o or u" (without quotes) on Soap's spiderweb and got 4.75, 4.68, 4.78, 4.82, and 4.54 on five searches of the same. Looks like I need to take new benchmarks.
Quote:
Originally Posted by SoapinTrucker
Winston, does the way a db/table get indexed help the speed? (I'm guessing it does, but the point is, HOW to make an index that speedy........mine seems to be in overdrive, it is fast! (LOL ))
|
The way content is inserted into the search table does not depend on, and I'd say (without testing indexes and such) it doesn't really affect, how tdSearch searches said table: tdSearch uses the same procedure i.e. script to search the table regardless of met hod used to insert table content.
|
![Old](images/statusicon/post_old.gif)
09-06-2005, 03:11 AM
|
![SoapinTrucker's Avatar](image.php?s=5dda35265d4ea00bdc36fd5c56677205&u=5&dateline=1121980122) |
Member
|
|
Join Date: Jul 2005
Location: Fresno, California
Posts: 38
|
|
did you type in the aeiou all at once, like this "a ?e ?i ?o ?u" (without quotes of course)? I just did, as a single search entry and it took 4.8, is that good? Didn't seem so bad here ![Smile](images/smilies/smile.gif)
|
![Old](images/statusicon/post_old.gif)
09-06-2005, 03:44 AM
|
Administrator
|
|
Join Date: Jul 2005
Posts: 46
|
|
Three new searches: "a or e or i or o or u" (with spaces, without quotes) => 4.72, 4.80, 4.46 seconds
Three new searches: "a ?e ?i ?o ?u" (with spaces, without quotes) => 4.52, 6.27, 4.86 seconds
|
![Old](images/statusicon/post_old.gif)
09-06-2005, 08:56 AM
|
![SoapinTrucker's Avatar](image.php?s=5dda35265d4ea00bdc36fd5c56677205&u=5&dateline=1121980122) |
Member
|
|
Join Date: Jul 2005
Location: Fresno, California
Posts: 38
|
|
Hmmmm.........so it IS fast, yes?
OK, I just now (5 min ago..........) updated the db, it now has:
25483 rows (links), and the table is 15MEG as reported by phpMyadmin,
Data 8,790 KB/Index 6,535 KB=Total 15,325 KB
Whooo hooo....pretty big, I'm not sure how big I can make it,
but I guess I'll find out (LOL).
Mike
|
![Old](images/statusicon/post_old.gif)
09-06-2005, 06:36 PM
|
Junior Member
|
|
Join Date: Sep 2005
Posts: 5
|
|
Quote:
Originally Posted by SoapinTrucker
Hmmmm.........so it IS fast, yes?
OK, I just now (5 min ago..........) updated the db, it now has:
25483 rows (links), and the table is 15MEG as reported by phpMyadmin,
Data 8,790 KB/Index 6,535 KB=Total 15,325 KB
Whooo hooo....pretty big, I'm not sure how big I can make it,
but I guess I'll find out (LOL).
Mike
|
well then...
looks encouraging! Thanks for the stat and the site to test out. It looks like I'll give it a go and see how well the package does. I'll post when I get some first impressions.
wish me luck
-m
|
Thread Tools |
Search this Thread |
|
|
Posting Rules
|
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is Off
|
|
|
All times are GMT. The time now is 09:23 AM.
|