org.archive.wayback.replay.charset

Class RotatingCharsetDetectorTest

java.lang.Object

junit.framework.Assert

junit.framework.TestCase

org.archive.wayback.replay.charset.RotatingCharsetDetectorTest

All Implemented Interfaces:

junit.framework.Test

public class RotatingCharsetDetectorTest
extends junit.framework.TestCase

test for RotatingCharsetDetector.

Constructor Summary

Constructors

Constructor and Description
RotatingCharsetDetectorTest()

Method Summary

Methods

Modifier and Type	Method and Description
protected WarcResource	createResource(String payload, String encoding)
protected WarcResource	createResource(String contentType, String payload, String encoding)
void	testContentTypeHeaderSniffer() test of ContentTypeHeaderSniffer
void	testFalseMetaUTF16() content is UTF-8 encoded, but META tag says it's UTF-16.
void	testFalseMetaUTF8() content is UTF-16 encoded, but META tag says it's UTF-8.
void	testXCharsetName() test of x- charset names.
void	testXUserDefined() test of x-user-defined charset name.

Methods inherited from class junit.framework.TestCase

countTestCases, createResult, getName, run, run, runBare, runTest, setName, setUp, tearDown, toString

Methods inherited from class junit.framework.Assert

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertTrue, assertTrue, fail, fail

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

RotatingCharsetDetectorTest

public RotatingCharsetDetectorTest()

Method Detail

createResource

protected WarcResource createResource(String payload,
                          String encoding)
                               throws IOException

Throws:

IOException

createResource

protected WarcResource createResource(String contentType,
                          String payload,
                          String encoding)
                               throws IOException

Throws:

IOException

testFalseMetaUTF16

public void testFalseMetaUTF16()
                        throws Exception

content is UTF-8 encoded, but META tag says it's UTF-16. PrescanMetadataSniffer overrides UTF-16 to UTF-8.

Throws:

Exception

testXCharsetName

public void testXCharsetName()
                      throws Exception

test of x- charset names.

Throws:

Exception

testXUserDefined

public void testXUserDefined()
                      throws Exception

test of x-user-defined charset name. mapped to windows-1252.

Throws:

Exception

testFalseMetaUTF8

public void testFalseMetaUTF8()
                       throws Exception

content is UTF-16 encoded, but META tag says it's UTF-8. PrescanMetadataSniffer shall fail because it's UTF-16 encoded, and UniversalChardetSniffer should detect UTF-16.

Unfortunately, this test fails currently. Universal Chardet returns null for sample content, even with some non-ASCII chars. Hopefully UTF-16 texts have BOM, or plenty of non-ASCII chars make Universal Chardet work.

Throws:

Exception

testContentTypeHeaderSniffer

public void testContentTypeHeaderSniffer()
                                  throws Exception

test of ContentTypeHeaderSniffer

Throws:

Exception