136 Commits

Author SHA1 Message Date
smontagu%smontagu.org
01b8bcfbe3 Fix some issues found with valgrind. Bug 479759, r=Masatoshi Kimura <VYV03354@nifty.ne.jp>, a1.9.0.10=dveditz
git-svn-id: svn://10.0.0.236/trunk@257013 18797224-902f-48f8-a5cc-f745e15eee43
2009-04-22 11:31:34 +00:00
smontagu%smontagu.org
b88b86c7cb Mochitests for charset autodetection
git-svn-id: svn://10.0.0.236/trunk@250545 18797224-902f-48f8-a5cc-f745e15eee43
2008-04-21 10:50:45 +00:00
smontagu%smontagu.org
ce3f2300a9 Use universal charset detector with filters instead of the old language-specific parallel state machines. Bug 426271, r+sr=dbaron, b=vladimir
git-svn-id: svn://10.0.0.236/trunk@249903 18797224-902f-48f8-a5cc-f745e15eee43
2008-04-09 06:36:23 +00:00
smontagu%smontagu.org
bc79f57b58 Remove unnecessary and obsolete code. Bug 424916, r+sr=dbaron, a=damons
git-svn-id: svn://10.0.0.236/trunk@248555 18797224-902f-48f8-a5cc-f745e15eee43
2008-03-25 20:19:34 +00:00
benjamin%smedbergs.us
7262cdad6d Bug 376636 - Building with gcc 4.3 and -pendatic fails due to extra semicolons, patch by Art Haas <ahaas@airmail.net>, rs=me
git-svn-id: svn://10.0.0.236/trunk@224885 18797224-902f-48f8-a5cc-f745e15eee43
2007-04-23 14:22:04 +00:00
timeless%mozdev.org
26b7b225ac Bug 106386 Correct misspellings in source code
also changing line to reference sequences since you don't count 'apple', you
count 'apples'.
r=glennrp@gmail.com, bclary@bclary.com rs=brendan


git-svn-id: svn://10.0.0.236/trunk@214561 18797224-902f-48f8-a5cc-f745e15eee43
2006-11-01 23:04:06 +00:00
smontagu%smontagu.org
b3ff0a2f79 Add a minimum data threshold to CharDistributionAnalysis::GetConfidence() to reduce false positives. Bug 306272, r=jshin, sr=rbs
git-svn-id: svn://10.0.0.236/trunk@206817 18797224-902f-48f8-a5cc-f745e15eee43
2006-08-08 10:35:30 +00:00
timeless%mozdev.org
a76272e6e6 Bug 328009 UniversalChardetTest.cpp(65) : warning C4800: 'const PRBool' : forcing value to bool 'true' or 'false' (performance warning)
r=smontagu sr=bz


git-svn-id: svn://10.0.0.236/trunk@192685 18797224-902f-48f8-a5cc-f745e15eee43
2006-03-21 06:35:45 +00:00
benjamin%smedbergs.us
e88f95eca3 Bug 78081 - don't export intermediate libraries - initial makefile changes to switch from $(DIST)/lib to in-tree library locations - blanket-r=mento
git-svn-id: svn://10.0.0.236/trunk@189973 18797224-902f-48f8-a5cc-f745e15eee43
2006-02-14 18:13:49 +00:00
bsmedberg%covad.net
9bae268baf Bug 320553 - integrate universalchardet into libxul, r=bryner
git-svn-id: svn://10.0.0.236/trunk@186186 18797224-902f-48f8-a5cc-f745e15eee43
2005-12-16 20:55:44 +00:00
jgmyers%speakeasy.net
e2342123d5 Bug 313211: improve universalchardet test harness r=somntagu
git-svn-id: svn://10.0.0.236/trunk@184044 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 19:43:32 +00:00
jgmyers%speakeasy.net
04a571beee Bug 177505: Misidentified iso-8859-1 text as GB18030 r=smontagu sr=roc
git-svn-id: svn://10.0.0.236/trunk@184043 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 19:41:13 +00:00
jgmyers%speakeasy.net
abffc902e3 Bug 313199: separate out build of universalchardet xpcom wrapper r=benjamin moa=smontagu
git-svn-id: svn://10.0.0.236/trunk@184042 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 19:38:32 +00:00
bsmedberg%covad.net
05628c3864 Beginning to land the PACKAGING_20030906_BRANCH for bug 20640. Not part of the build, yet.
git-svn-id: svn://10.0.0.236/trunk@184034 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:29 +00:00
timeless%mozdev.org
8f264d65b5 Bug 86999 - Hebrew support for Universal (All) Autodetect
fixing debug output typo
patch by shoosh20012001@hotmail.com r=smontagu sr=roc a=asa


git-svn-id: svn://10.0.0.236/trunk@184033 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:28 +00:00
mozilla.mano%sent.com
235461eb4b Bug 304951 - error in chardet's Hebrew language model. patch from Shy Shalom <shoosh20012001@hotmail.com>, r=smontagu, sr=roc.
git-svn-id: svn://10.0.0.236/trunk@184032 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:27 +00:00
timeless%mozdev.org
638645af45 Bug 86999 Hebrew support for Universal (All) Autodetect
patch by shoosh20012001@hotmail.com r=smontagu r=timeless sr=roc a=asa
HebrewProber written by shoosh20012001@hotmail.com
LangHebrewModel written by smontagu
some data compiled by xslf@xslf.com


git-svn-id: svn://10.0.0.236/trunk@184031 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:26 +00:00
jshin%mailaps.org
5a5707a577 separate xpcom wrapper and charset detectors : patch by shanjian with some updates by me (r=smontagu, sr=alecf)
git-svn-id: svn://10.0.0.236/trunk@184030 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:25 +00:00
timeless%mozdev.org
cee872068e Bug 228545 Bug "FilterWith..." in universal charset detector
patch by vladimir@lukianov.name r=smontagu sr=roc


git-svn-id: svn://10.0.0.236/trunk@184029 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:24 +00:00
timeless%mozdev.org
a7e4b61889 Bug 248307 lack of {} in mozilla\extensions\universalchardet\src\nsEUCJPProber.cpp:80
patch by vladimir@lukianov.name r=roc sr=roc


git-svn-id: svn://10.0.0.236/trunk@184028 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:23 +00:00
timeless%mozdev.org
1a8ef09e55 Bug 225994 DRefTool analysis for universalchardet files
r=smontagu sr=roc


git-svn-id: svn://10.0.0.236/trunk@184027 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:22 +00:00
timeless%mozdev.org
81d099d114 Bug 228542 Divide by zero bug in Universal charset detecter
patch by vladimir@lukianov.name r=smontagu sr=roc


git-svn-id: svn://10.0.0.236/trunk@184026 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:21 +00:00
gerv%gerv.net
f302fdfa53 Bug 236613: change to MPL/LGPL/GPL tri-license.
git-svn-id: svn://10.0.0.236/trunk@184025 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:20 +00:00
jgmyers%speakeasy.net
c4dc9c3c9a Accept halfwidth katakana in iso-2022-jp: bug 172393 r=ftang sr=roc
git-svn-id: svn://10.0.0.236/trunk@184024 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:19 +00:00
bzbarsky%mit.edu
0c4bed56af Make frequence tables in universal charset decoder const to move them into the
readonly segment.  Bug 201361, patch by ataylor@its.to (Andrew Taylor),
r=smontagu, sr=alecf


git-svn-id: svn://10.0.0.236/trunk@184023 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:18 +00:00
shanjian%netscape.com
82aed131f4 #92806 need to support GB18030 in universal detector
replace gb18030 state machine with the new one, which has been tested in
PSM detector.
r=ftang, sr=scc


git-svn-id: svn://10.0.0.236/trunk@184022 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:17 +00:00
shanjian%netscape.com
7b96e9831c #111340 Autodetect All detect SJIS as Greek
r=yokoyama, sr=brendan


git-svn-id: svn://10.0.0.236/trunk@184021 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:16 +00:00
bryner%brianryner.com
34ad2714cc Fix build on gcc 3.4 by removing extra semicolons (bug 218551). r/sr=dbaron, a=brendan.
git-svn-id: svn://10.0.0.236/trunk@184020 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:15 +00:00
jgmyers%netscape.com
876d07164c fix uninitialized member: bug 222182 r=sli0262 sr=blizzard
git-svn-id: svn://10.0.0.236/trunk@184019 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:14 +00:00
shanjian%netscape.com
8bc44b42bd #115114 autodetect universal detects french as Central European (ISO-8859-2)
remove 2 hungarian probers.
r=ftang, sr=scc


git-svn-id: svn://10.0.0.236/trunk@184018 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:13 +00:00
jaggernaut%netscape.com
453faf4cf0 Bug 25886: Get rid of a bunch of unused NS_DEFINE_IID, NS_DEFINE_CID. r=caillon, sr=dbaron
git-svn-id: svn://10.0.0.236/trunk@184017 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:12 +00:00
shanjian%netscape.com
996c77052c #171813 Universal auto detector doesn't work well on sohu news page
adjust the detecting parameter.
r=ftang, sr=jst


git-svn-id: svn://10.0.0.236/trunk@184016 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:11 +00:00
dbaron%dbaron.org
e084b23204 Fix build warnings by using character literals. b=183354 r=smontagu sr=bzbarsky
git-svn-id: svn://10.0.0.236/trunk@184015 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:10 +00:00
yokoyama%netscape.com
0b5d34439c 162894
Universal Auto Detector regression fix.
/r=yokoyama, shanjian, /sr=jst, /a=asa


git-svn-id: svn://10.0.0.236/trunk@184014 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:09 +00:00
cbiesinger%web.de
2173c4a83f 183354 patch by alexey@optus.net (Alexey Chernyak) r=ftang sr=blizzard Make Universal Charset Autodetector recognise UTF by BOM
git-svn-id: svn://10.0.0.236/trunk@184013 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:08 +00:00
dbaron%dbaron.org
583542aff7 Bug 178643: Remove uses of NS_INIT_ISUPPORTS, since it is no longer needed. r=timeless sr=jag
git-svn-id: svn://10.0.0.236/trunk@184012 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:07 +00:00
shanjian%netscape.com
02b959afa6 #162894 Extend universal detector's coverage to include iso-8859-1
Added latin1 prober.
r=smontagu, sr=jst, a=asa


git-svn-id: svn://10.0.0.236/trunk@184011 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:06 +00:00
dougt%netscape.com
c99559a8c5 166917. Clean up xpcom SDK includes. r=rpotts@netscape.com, sr=alecf@netscape.com, a=rjesup@wgate.com
git-svn-id: svn://10.0.0.236/trunk@184010 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:05 +00:00
shanjian%netscape.com
1268780cfc #92806 need to support GB18030 in universal detector
replace state machine for gb18030 with the new one, which has been tested
in PSM detector.
r=ftang, sr=scc,


git-svn-id: svn://10.0.0.236/trunk@184009 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:04 +00:00
shanjian%netscape.com
154a24ea8b #122081 Universalchardet leaks memory
The fix for the nsCharSetProber class declaration, plus fix for
nsUniversalDetector methods, which may cause another leak when the object is
reused after Reset().

Patch proposed by Takayuki Tamura
r=shanjian, sr/a=brendan


git-svn-id: svn://10.0.0.236/trunk@184008 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:03 +00:00
shanjian%netscape.com
da52165192 #109913 universal charset detector improvement: use positive approach
r=yokoyama, sr=brendan


git-svn-id: svn://10.0.0.236/trunk@184007 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:02 +00:00
shanjian%netscape.com
81e879c77d #119377 NS crashes if use universal Charset detector on in frame
Added some range verification when calculating order.
r=nhotta, sr=brendan


git-svn-id: svn://10.0.0.236/trunk@184006 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:01 +00:00
alecf%netscape.com
3546f38b84 argh, also patch universal char det
similar to patch by bzbarsky@mit.edu that I had in my tree
fixes extensions bustage


git-svn-id: svn://10.0.0.236/trunk@184005 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:57:00 +00:00
shanjian%netscape.com
71816d39aa #180988 ¨¢¨¦¨ª¨®¨²¨¤¨¨¨¬¨°¨´¨¢¨¦¨ª¨®¨²¨¤¨¨¨¬¨°¨´ in text causes universal AD to display in Big5
count every char for total.
yokoyama: review+
bzbarsky: superreview+


git-svn-id: svn://10.0.0.236/trunk@184004 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:56:59 +00:00
timeless%mozdev.org
8b77839290 Bug 207057 Division by zero in UCDET.DLL
r=smontagu sr=rbs


git-svn-id: svn://10.0.0.236/trunk@184003 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:56:58 +00:00
shanjian%netscape.com
61accdf676 #100377 Auto-detect All detects yahoo-japan page as a wrong charset that save by Composer
r=yokoyama, sr=brendan


git-svn-id: svn://10.0.0.236/trunk@184002 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:56:57 +00:00
dbaron%fas.harvard.edu
d29cec0c61 Remove more no-longer-needed nsComponentManager::RegisterComponent calls. Remove remnants of NS_IMPL_IDS macro, associated with long-gone NS_DECLARE_ID. b=125782 r=dougt rs=jag
git-svn-id: svn://10.0.0.236/trunk@184001 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:56:56 +00:00
sfraser%netscape.com
532639c47d Making the nsModuleComponentInfo data const; bug 74803. r=dp, sr=waterson
git-svn-id: svn://10.0.0.236/trunk@184000 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:56:55 +00:00
gerv%gerv.net
4d1ec9d4f7 License changes, take 2. Bug 98089. mozilla/extensions/.
git-svn-id: svn://10.0.0.236/trunk@183999 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:56:54 +00:00
gerv%gerv.net
5d2f873c09 Oops.
git-svn-id: svn://10.0.0.236/trunk@183998 18797224-902f-48f8-a5cc-f745e15eee43
2005-11-02 16:56:53 +00:00