Monthly Archives: February 2015

Quickly generate sequence of dates

DECLARE @Dates TABLE ([Date] date) INSERT INTO @Dates([Date]) SELECT DATEADD(DAY, NUMBER, ‘1 mar 2012’) FROM (SELECT DISTINCT number FROM master.dbo.spt_values WHERE NAME IS NULL) N WHERE DATEADD(DAY, NUMBER, ‘1 mar 2012’) < ‘1 may 2013’

Posted in Uncategorized | Tagged | Leave a comment

Splitting large file with PowerShell script

$linecount = 0 $filenumber = 1 $content = get-content C:\…\trans.csv | % { Add-Content C:\…\trans\trans$filenumber.csv “$_” $linecount ++ If ($linecount -eq 200000) { $filenumber++ If ($filenumber -eq 4) {Exit} $linecount = 0 } } Full solution can be found here.

Posted in Uncategorized | Tagged | Leave a comment

Crucial points in big data governance.

1. Ensure data is properly catalogued and easily discoverable and establish simple easy to follow methods to ensure your users are part of the governance process. 2. You need a clear sense of who the key stakeholders/decision makers are. 3. … Continue reading

Posted in Uncategorized | Leave a comment