Skip to content

Octivian/sendlog_datawarehouse

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 

Repository files navigation

sendlog_datawarehouse

hive for send_log format

my log format -> https://github.com/Octivian/sendlog_datawarehouse/blob/master/Sample-Log-Format.log

make a jar,add it to hive classpath.

CREATE EXTERNAL TABLE test_send_log ( userip STRING, serverip STRING, TIMESTAMP TIMESTAMP, uri STRING, referer STRING, HOST STRING, useragent STRING, cookie STRING, id INT ) PARTITIONED BY (dq INT, date DATE) ROW FORMAT SERDE 'datawarehouse.io.serde.SendLogSerde' STORED AS INPUTFORMAT 'datawarehouse.io.inputformat.SendLogInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat' LOCATION '/user/kodo/test/hive/';

About

hive for send_log format

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages